Sep 02 00:33:35 devstack cinder-volume[76235]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 00:33:35 devstack cinder-volume[76235]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 00:33:35 devstack cinder-volume[76235]: we strongly recommend against using it for new projects. Sep 02 00:33:35 devstack cinder-volume[76235]: If you are already using Eventlet, we recommend migrating to a different Sep 02 00:33:35 devstack cinder-volume[76235]: framework. For more detail see Sep 02 00:33:35 devstack cinder-volume[76235]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 00:33:35 devstack cinder-volume[76235]: import eventlet # noqa Sep 02 00:33:38 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 00:33:38 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 00:33:38 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 00:33:38 devstack cinder-volume[76235]: INFO dbcounter [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Registered counter for database cinder Sep 02 00:33:39 devstack cinder-volume[76235]: DEBUG oslo_db.sqlalchemy.engines [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:33:39 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writer thread running {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 00:33:39 devstack cinder-volume[76235]: INFO cinder.rpc [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 00:33:39 devstack cinder-volume[76235]: INFO cinder.rpc [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 00:33:39 devstack cinder-volume[76235]: DEBUG oslo_db.sqlalchemy.engines [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:33:39 devstack cinder-volume[76235]: INFO cinder.volume.manager [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Determined volume DB was empty at startup. Sep 02 00:33:39 devstack cinder-volume[76235]: DEBUG cinder.volume.manager [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76235) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 00:33:39 devstack cinder-volume[76235]: INFO cinder.volume.manager [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 02 00:33:39 devstack cinder-volume[76235]: WARNING stevedore.named [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 00:33:39 devstack cinder-volume[76235]: WARNING castellan.key_manager [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 00:33:39 devstack cinder-volume[76235]: WARNING cinder.keymgr.conf_key_mgr [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 00:33:39 devstack cinder-volume[76235]: DEBUG cinder.volume.drivers.lvm [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76235) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 02 00:33:39 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:39 devstack cinder-volume[76235]: DEBUG oslo_concurrency.processutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] CMD "cinder-rtstool verify" returned: 0 in 0.409s {{(pid=76235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_db.sqlalchemy.engines [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:33:40 devstack cinder-volume[76235]: INFO cinder.rpc [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 02 00:33:40 devstack cinder-volume[76235]: INFO cinder.rpc [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 02 00:33:40 devstack cinder-volume[76235]: WARNING stevedore.named [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 00:33:40 devstack cinder-volume[76235]: WARNING castellan.key_manager [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 00:33:40 devstack cinder-volume[76235]: INFO cinder.volume.manager [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_db.sqlalchemy.engines [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:33:40 devstack cinder-volume[76235]: INFO oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Starting 1 workers Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Started child 76389 {{(pid=76235) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Full set of CONF: {{(pid=76235) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] ******************************************************************************** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Configuration options gathered from: {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 00:33:40 devstack cinder-volume[76389]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] ================================================================================ {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] allow_availability_zone_fallback = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] allow_compression_on_image_upload = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] allowed_direct_url_schemes = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] api_rate_limit = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] auth_strategy = keystone {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] az_cache_duration = 3600 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_availability_zone = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_host = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_stats_polling_interval = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backup_api_class = cinder.backup.api.API {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backup_name_template = backup-%s {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backup_use_same_host = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backup_use_temp_snapshot = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] chap_password = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] chap_username = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_internal_tenant_project_id = 70bb5e3d15484e128936aceb4d264bc7 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_internal_tenant_user_id = 10fd85a3f7e04324bb5cc9f962f1e956 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cloned_volume_same_az = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cluster = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] compression_format = gzip {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] compute_api_class = cinder.compute.nova.API {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] config_dir = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] config_source = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] control_exchange = openstack {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] debug = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] default_availability_zone = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] default_group_type = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] default_volume_type = lvmdriver-1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] disk_geometry = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] driver_client_cert = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] driver_client_cert_key = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] driver_data_namespace = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] driver_ssl_cert_path = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] driver_ssl_cert_verify = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] driver_use_ssl = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] enable_force_upload = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] enable_new_services = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] enable_unsupported_driver = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] enforce_multipath_for_image_xfer = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] filter_function = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_api_insecure = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_api_servers = ['http://192.168.122.129/image'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_api_ssl_compression = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_ca_certificates_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_catalog_info = image:glance:publicURL {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_num_retries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance_request_timeout = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] goodness_function = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] graceful_shutdown_timeout = 5 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] group_api_class = cinder.group.api.API {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] host = devstack {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_compress_on_upload = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_conversion_address_space_limit = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_conversion_cpu_limit = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_conversion_disable = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_upload_use_cinder_backend = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_upload_use_internal_tenant = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_volume_cache_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_volume_cache_max_count = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] image_volume_cache_max_size_gb = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] init_host_max_objects_retrieval = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] instance_format = [instance: %(uuid)s] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] iscsi_target_flags = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] iscsi_write_cache = on {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] iser_helper = tgtadm {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] iser_ip_address = 192.168.122.129 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] iser_port = 3260 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_color = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_config_append = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_dir = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_options = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_rotate_interval = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_rotate_interval_type = days {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] log_rotation_type = none {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] max_age = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] max_logfile_count = 30 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] max_logfile_size_mb = 200 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] max_over_subscription_ratio = 20.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] message_reap_interval = 86400 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] message_ttl = 2592000 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] migration_create_volume_timeout_secs = 300 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] monkey_patch = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] monkey_patch_modules = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] my_ip = 192.168.122.129 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76389]: INFO cinder.volume.manager [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] no_snapshot_gb_quota = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] num_iser_scan_tries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] num_shell_tries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] num_volume_device_scan_tries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] nvmeof_conn_info_version = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] nvmet_ns_id = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] nvmet_port_id = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] osapi_max_limit = 1000 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] osapi_volume_ext_list = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] osapi_volume_listen_port = 8776 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] osapi_volume_use_ssl = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] osapi_volume_workers = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] per_volume_size_limit = -1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] periodic_fuzzy_delay = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] periodic_interval = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] public_endpoint = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] publish_errors = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] quota_backup_gigabytes = 1000 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] quota_backups = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] quota_gigabytes = 1000 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] quota_groups = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] quota_snapshots = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] quota_volumes = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] rate_limit_burst = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] rate_limit_except_level = CRITICAL {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] rate_limit_interval = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] reinit_driver_count = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] replication_device = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] report_discard_supported = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] report_interval = 120 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] reservation_clean_interval = 86400 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] reservation_expire = 86400 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] reserved_image_namespaces = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] reserved_percentage = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] rpc_response_timeout = 120 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] run_external_periodic_tasks = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] scst_target_driver = iscsi {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] scst_target_iqn_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_down_time = 720 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] shell_completion = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] snapshot_name_template = snapshot-%s {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] snapshot_same_host = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] split_loggers = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] state_path = /opt/stack/data/cinder {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] storage_availability_zone = nova {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] storage_protocol = iSCSI {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] syslog_log_facility = LOG_USER {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] target_helper = lioadm {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] target_ip_address = 192.168.122.129 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] target_port = 3260 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] target_protocol = iscsi {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] target_secondary_ip_addresses = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] trace_flags = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] transport_url = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] until_refresh = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] use_chap_auth = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] use_default_quota_class = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] use_journal = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] use_json = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] use_multipath_for_image_xfer = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] use_stderr = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] use_syslog = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] verify_glance_signatures = enabled {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_api_class = cinder.volume.api.API {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_backend_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_clear = zero {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_clear_ionice = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_clear_size = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_copy_bps_limit = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_dd_blocksize = 1M {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_name_template = volume-%s {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_service_inithost_offload = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volume_usage_audit_period = month {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] zoning_mode = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_concurrency.disable_process_locking = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.auth_section = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.auth_type = password {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.auth_version = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.cache = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.include_service_catalog = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.insecure = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.interface = public {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_password = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcache_username = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.region_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.service_type = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.backend = dogpile.cache.null {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.backend_argument = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.backend_expiration_time = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.config_prefix = cache.oslo {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.debug_cache_backend = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.enable_retry_client = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.enable_socket_keepalive = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.expiration_time = 600 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.hashclient_retry_attempts = 2 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.memcache_dead_retry = 300 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.memcache_pool_maxsize = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.memcache_sasl_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.password = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.proxies = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.redis_db = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.redis_server = localhost:6379 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.retry_attempts = 2 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.retry_delay = 0.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.socket_keepalive_count = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.socket_keepalive_idle = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.socket_keepalive_interval = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.socket_timeout = 1.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.tls_allowed_ciphers = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.tls_cafile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.tls_certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.tls_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.tls_keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cache.username = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] coordination.backend_url = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.asyncio_connection = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.asyncio_slave_connection = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.backend = sqlalchemy {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.connection = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.connection_debug = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.connection_parameters = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.connection_recycle_time = 3600 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.connection_trace = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.db_inc_retry_interval = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.db_max_retries = 20 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.db_max_retry_interval = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.db_retry_interval = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.max_overflow = 50 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.max_pool_size = 5 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.max_retries = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.mysql_wsrep_sync_wait = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.pool_timeout = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.retry_interval = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.slave_connection = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.sqlite_synchronous = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.synchronous_reader = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] database.use_db_reconnect = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack sudo[76394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:40 devstack sudo[76394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_tracing.insecure = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.connection_string = messaging:// {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.es_doc_type = notification {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.es_scroll_size = 10000 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.es_scroll_time = 2m {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.filter_error_trace = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.hmac_keys = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.sentinel_service_name = mymaster {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.socket_timeout = 0.1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.trace_requests = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler.trace_sqlalchemy = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler_jaeger.process_tags = {} {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler_jaeger.service_name_prefix = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] profiler_otlp.service_name_prefix = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.enforce_new_defaults = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.policy_default_rule = default {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.policy_file = policy.yaml {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] privsep_osbrick.group = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] privsep_osbrick.helper_command = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] privsep_osbrick.user = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_sys_admin.group = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_sys_admin.helper_command = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] cinder_sys_admin.user = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.auth_section = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.auth_type = password {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.cafile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.collect_timing = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.insecure = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.send_service_user_token = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.split_loggers = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.timeout = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.tls_ciphers = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] service_user.tls_min_version = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.auth_section = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.auth_type = password {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.collect_timing = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.insecure = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.region_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.split_loggers = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.timeout = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.tls_ciphers = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] glance.tls_min_version = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.backend_availability_zone = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.chap_password = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.chap_username = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.disk_geometry = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.driver_client_cert = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.driver_client_cert_key = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.driver_data_namespace = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.driver_use_ssl = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.extra_capabilities = {} {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.filter_function = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.goodness_function = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.iscsi_target_flags = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.iscsi_write_cache = on {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.iser_helper = tgtadm {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.iser_port = 3260 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.lvm_share_target = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.lvm_type = auto {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.num_shell_tries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.replication_device = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.report_discard_supported = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.reserved_percentage = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.target_helper = tgtadm {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.target_port = 3260 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.target_protocol = iscsi {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.trace_flags = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.unique_fqdn_network = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.use_chap_auth = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_backend_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_clear = zero {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_clear_ionice = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_clear_size = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_reports.file_event_handler = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_reports.log_dir = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.backend_host = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.chap_password = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.chap_username = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.disk_geometry = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.driver_client_cert = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.extra_capabilities = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.filter_function = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.goodness_function = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.iser_helper = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.iser_ip_address = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.iser_port = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.lvm_share_target = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.lvm_type = auto {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.num_shell_tries = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.replication_device = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.report_discard_supported = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.reserved_percentage = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.scst_target_driver = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.storage_protocol = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.target_helper = lioadm {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.target_ip_address = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.target_port = 3260 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.trace_flags = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.use_chap_auth = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_clear = zero {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_clear_size = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] lvmdriver-1.volumes_dir = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.ssl = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_notifications.driver = [] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_notifications.retry = -1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] key_manager.fixed_key = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.barbican_api_version = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.barbican_endpoint = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.barbican_endpoint_type = public {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.barbican_region_name = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.cafile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.collect_timing = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.insecure = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.number_of_retries = 60 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.retry_delay = 1 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.send_service_user_token = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.split_loggers = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.timeout = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.tls_ciphers = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.tls_min_version = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.verify_ssl = True {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican.verify_ssl_path = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.auth_section = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.auth_type = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.cafile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.certfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.collect_timing = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.insecure = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.keyfile = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.split_loggers = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.timeout = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.tls_ciphers = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] barbican_service_user.tls_min_version = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.approle_role_id = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.approle_secret_id = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.auth_method = approle {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.auth_path = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.kv_mountpoint = secret {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.kv_path = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.kv_version = 2 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.namespace = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.root_token_id = **** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.ssl_ca_crt_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.timeout = 60.0 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.token_file = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.token_role = None {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.use_ssl = False {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:33:40 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] ******************************************************************************** {{(pid=76235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 00:33:40 devstack sudo[76394]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.408s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:40 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:40 devstack sudo[76520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:40 devstack sudo[76520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:41 devstack sudo[76520]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.245s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:33:41 devstack cinder-volume[76389]: INFO cinder.brick.local_dev.lvm [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:41 devstack sudo[76615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:33:41 devstack sudo[76615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:41 devstack sudo[76615]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG cinder.brick.local_dev.lvm [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76389) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:41 devstack sudo[76701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:41 devstack sudo[76701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:41 devstack sudo[76701]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.529s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:41 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:41 devstack sudo[76900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:41 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:42 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:42 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 02 00:33:42 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:42 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.269s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:42 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:33:42 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:42 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:42 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:42 devstack sudo[77091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:33:42 devstack sudo[77091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:43 devstack sudo[77091]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:43 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:33:43 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:43 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:43 devstack sudo[77155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:43 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:43 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:43 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:43 devstack sudo[77187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:43 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:44 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:44 devstack cinder-volume[76389]: INFO cinder.volume.drivers.lvm [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:44 devstack sudo[77197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:44 devstack sudo[77197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:44 devstack sudo[77197]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG cinder.volume.drivers.lvm [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Updating volume stats {{(pid=76389) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:44 devstack sudo[77200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:33:44 devstack sudo[77200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:44 devstack sudo[77200]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:44 devstack sudo[77203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:33:44 devstack sudo[77203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:44 devstack sudo[77203]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:44 devstack sudo[77206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:44 devstack sudo[77206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:45 devstack sudo[77206]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:45 devstack sudo[77209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:33:45 devstack sudo[77209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:45 devstack sudo[77209]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:45 devstack cinder-volume[76389]: INFO cinder.volume.driver [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Driver hasn't implemented _init_vendor_properties() Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG cinder.volume.driver [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76389) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG oslo_db.sqlalchemy.engines [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76389) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG dbcounter [-] [76389] Writer thread running {{(pid=76389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG cinder.db.api [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Building query based on filter {{(pid=76389) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG cinder.image.image_utils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76389) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 00:33:45 devstack cinder-volume[76389]: INFO cinder.keymgr.migration [None req-45ae1c19-0ae0-47dd-9a16-1d9b8f7be47d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG cinder.volume.drivers.lvm [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Updating volume stats {{(pid=76389) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:45 devstack sudo[77212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:33:45 devstack sudo[77212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:45 devstack sudo[77212]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:45 devstack sudo[77218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:33:45 devstack sudo[77218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:46 devstack sudo[77218]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:46 devstack sudo[77221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:46 devstack sudo[77221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:46 devstack sudo[77221]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:46 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:33:46 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:46 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG cinder.manager [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Notifying Schedulers of capabilities ... {{(pid=76389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:33:46 devstack cinder-volume[76389]: INFO cinder.volume.manager [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Driver initialization completed successfully. Sep 02 00:33:46 devstack cinder-volume[76389]: INFO cinder.manager [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Initiating service 2 cleanup Sep 02 00:33:46 devstack cinder-volume[76389]: INFO cinder.manager [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Service 2 cleanup completed. Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG cinder.service [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Creating RPC server for service cinder-volume {{(pid=76389) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG cinder.service [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76389) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 00:33:46 devstack cinder-volume[76389]: INFO cinder.volume.manager [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG cinder.volume.drivers.lvm [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Updating volume stats {{(pid=76389) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 00:33:46 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:46 devstack sudo[77229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:33:46 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:47 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:47 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:47 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:47 devstack sudo[77232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:33:47 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:47 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:47 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:47 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:47 devstack sudo[77238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:33:47 devstack sudo[77238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:47 devstack sudo[77238]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:47 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:47 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:33:47 devstack sudo[77241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:33:47 devstack sudo[77241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:33:47 devstack sudo[77241]: pam_unix(sudo:session): session closed for user root Sep 02 00:33:47 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:33:47 devstack cinder-volume[76389]: INFO cinder.volume.manager [None req-29c52ac0-a757-4500-9787-db4a9022fd55 None None] Driver post RPC initialization completed successfully. Sep 02 00:33:50 devstack cinder-volume[76235]: DEBUG dbcounter [-] [76235] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:33:56 devstack cinder-volume[76389]: DEBUG dbcounter [-] [76389] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:33:57 devstack cinder-volume[76389]: DEBUG dbcounter [-] [76389] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:34:44 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:34:44 devstack cinder-volume[76389]: DEBUG cinder.volume.drivers.lvm [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Updating volume stats {{(pid=76389) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 00:34:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:34:44 devstack sudo[79246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:34:44 devstack sudo[79246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:34:45 devstack sudo[79246]: pam_unix(sudo:session): session closed for user root Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:34:45 devstack sudo[79249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:34:45 devstack sudo[79249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:34:45 devstack sudo[79249]: pam_unix(sudo:session): session closed for user root Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:34:45 devstack sudo[79252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:34:45 devstack sudo[79252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:34:45 devstack sudo[79252]: pam_unix(sudo:session): session closed for user root Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:34:45 devstack sudo[79255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:34:45 devstack sudo[79255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:34:45 devstack sudo[79255]: pam_unix(sudo:session): session closed for user root Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG cinder.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Notifying Schedulers of capabilities ... {{(pid=76389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager._thread_info {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread count: 6 {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:34:45 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread info: [<_MainThread(MainThread, started 135311823544448)>, , , , , ] {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:35:44 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:35:44 devstack cinder-volume[76389]: DEBUG cinder.volume.drivers.lvm [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Updating volume stats {{(pid=76389) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 00:35:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:35:44 devstack sudo[82564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:35:44 devstack sudo[82564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:35:45 devstack sudo[82564]: pam_unix(sudo:session): session closed for user root Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:35:45 devstack sudo[82567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:35:45 devstack sudo[82567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:35:45 devstack sudo[82567]: pam_unix(sudo:session): session closed for user root Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:35:45 devstack sudo[82610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:35:45 devstack sudo[82610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:35:45 devstack sudo[82610]: pam_unix(sudo:session): session closed for user root Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:35:45 devstack sudo[82614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:35:45 devstack sudo[82614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:35:45 devstack sudo[82614]: pam_unix(sudo:session): session closed for user root Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG cinder.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Notifying Schedulers of capabilities ... {{(pid=76389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager._thread_info {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread count: 6 {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:35:45 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread info: [<_MainThread(MainThread, started 135311823544448)>, , , , , ] {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:35:57 devstack cinder-volume[76389]: DEBUG dbcounter [-] [76389] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:36:44 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:36:44 devstack cinder-volume[76389]: DEBUG cinder.volume.drivers.lvm [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Updating volume stats {{(pid=76389) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 00:36:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:36:44 devstack sudo[84649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:36:44 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:36:45 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:36:45 devstack sudo[84661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:36:45 devstack sudo[84661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:36:45 devstack sudo[84661]: pam_unix(sudo:session): session closed for user root Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:36:45 devstack sudo[84664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:36:45 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:36:45 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:36:45 devstack sudo[84670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:36:45 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:36:45 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG cinder.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Notifying Schedulers of capabilities ... {{(pid=76389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager._thread_info {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread count: 6 {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:36:45 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread info: [<_MainThread(MainThread, started 135311823544448)>, , , , , ] {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:37:44 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:37:44 devstack cinder-volume[76389]: DEBUG cinder.volume.drivers.lvm [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Updating volume stats {{(pid=76389) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 02 00:37:44 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:37:44 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 02 00:37:44 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:37:45 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:37:45 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:37:45 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:37:45 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:37:45 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 02 00:37:45 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:37:45 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:37:45 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 02 00:37:45 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:37:45 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG oslo_concurrency.processutils [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:37:45 devstack cinder-volume[76389]: DEBUG cinder.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Notifying Schedulers of capabilities ... {{(pid=76389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:37:46 devstack cinder-volume[76389]: DEBUG oslo_service.periodic_task [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] Running periodic task VolumeManager._thread_info {{(pid=76389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:37:46 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread count: 6 {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:37:46 devstack cinder-volume[76389]: DEBUG cinder.volume.manager [None req-aed7d1e9-bb5c-43cc-8640-6e60ae20e18b None None] thread info: [<_MainThread(MainThread, started 135311823544448)>, , , , , ] {{(pid=76389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:37:57 devstack cinder-volume[76389]: DEBUG dbcounter [-] [76389] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:38:01 devstack cinder-volume[76235]: INFO oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Caught SIGTERM, stopping children Sep 02 00:38:01 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Acquiring lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 00:38:01 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Acquired lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 00:38:01 devstack cinder-volume[76235]: DEBUG oslo_concurrency.lockutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Releasing lock "singleton_lock" {{(pid=76235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 00:38:01 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Stop services. {{(pid=76235) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 02 00:38:01 devstack cinder-volume[76235]: DEBUG oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Killing children. {{(pid=76235) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 02 00:38:01 devstack cinder-volume[76235]: INFO oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Waiting on 1 children to exit Sep 02 00:38:01 devstack cinder-volume[76389]: DEBUG oslo_concurrency.lockutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Acquiring lock "singleton_lock" {{(pid=76389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 00:38:01 devstack cinder-volume[76389]: DEBUG oslo_concurrency.lockutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Acquired lock "singleton_lock" {{(pid=76389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 00:38:01 devstack cinder-volume[76389]: DEBUG oslo_concurrency.lockutils [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Releasing lock "singleton_lock" {{(pid=76389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 00:38:01 devstack cinder-volume[76389]: WARNING amqp [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 00:38:01 devstack cinder-volume[76389]: WARNING amqp [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 00:38:01 devstack cinder-volume[76235]: INFO oslo_service.backend._eventlet.service [None req-4f42fb86-7361-4c0e-a0fb-808f834abc35 None None] Child 76389 exited with status 0 Sep 02 00:38:02 devstack cinder-volume[86375]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 00:38:02 devstack cinder-volume[86375]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 00:38:02 devstack cinder-volume[86375]: we strongly recommend against using it for new projects. Sep 02 00:38:02 devstack cinder-volume[86375]: If you are already using Eventlet, we recommend migrating to a different Sep 02 00:38:02 devstack cinder-volume[86375]: framework. For more detail see Sep 02 00:38:02 devstack cinder-volume[86375]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 00:38:02 devstack cinder-volume[86375]: import eventlet # noqa Sep 02 00:38:04 devstack cinder-volume[86375]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 00:38:04 devstack cinder-volume[86375]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 00:38:04 devstack cinder-volume[86375]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 00:38:04 devstack cinder-volume[86375]: INFO dbcounter [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Registered counter for database cinder Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_db.sqlalchemy.engines [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86375) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG dbcounter [-] [86375] Writer thread running {{(pid=86375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 00:38:05 devstack cinder-volume[86375]: INFO cinder.rpc [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 00:38:05 devstack cinder-volume[86375]: INFO cinder.rpc [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_db.sqlalchemy.engines [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86375) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:05 devstack cinder-volume[86375]: INFO cinder.volume.manager [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Determined volume DB was empty at startup. Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG cinder.volume.manager [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86375) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 00:38:05 devstack cinder-volume[86375]: INFO cinder.volume.manager [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 02 00:38:05 devstack cinder-volume[86375]: WARNING stevedore.named [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 00:38:05 devstack cinder-volume[86375]: WARNING castellan.key_manager [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 00:38:05 devstack cinder-volume[86375]: WARNING cinder.keymgr.conf_key_mgr [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 00:38:05 devstack cinder-volume[86375]: INFO cinder.volume.manager [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_db.sqlalchemy.engines [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86375) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:05 devstack cinder-volume[86375]: INFO oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Starting 1 workers Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Started child 86591 {{(pid=86375) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Full set of CONF: {{(pid=86375) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] ******************************************************************************** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Configuration options gathered from: {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] ================================================================================ {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] allow_availability_zone_fallback = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] allow_compression_on_image_upload = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86591]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] allowed_direct_url_schemes = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] api_rate_limit = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] auth_strategy = keystone {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_availability_zone = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_host = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_stats_polling_interval = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backup_api_class = cinder.backup.api.API {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backup_name_template = backup-%s {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backup_use_same_host = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backup_use_temp_snapshot = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] chap_password = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] chap_username = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_internal_tenant_project_id = 70bb5e3d15484e128936aceb4d264bc7 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_internal_tenant_user_id = 10fd85a3f7e04324bb5cc9f962f1e956 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cluster = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] compression_format = gzip {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] compute_api_class = cinder.compute.nova.API {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] config_dir = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] config_source = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] control_exchange = openstack {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] debug = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] default_availability_zone = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] default_group_type = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] default_volume_type = QuobyteHD {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] disk_geometry = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] driver_client_cert = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] driver_client_cert_key = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] driver_data_namespace = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] driver_ssl_cert_path = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] driver_ssl_cert_verify = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] driver_use_ssl = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] enable_new_services = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] enable_unsupported_driver = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] enabled_backends = ['QuobyteHD'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] enforce_multipath_for_image_xfer = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] filter_function = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_api_insecure = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_api_servers = ['http://192.168.122.129/image'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_api_ssl_compression = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_ca_certificates_file = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_catalog_info = image:glance:publicURL {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_num_retries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance_request_timeout = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] goodness_function = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] graceful_shutdown_timeout = 5 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] group_api_class = cinder.group.api.API {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] host = devstack {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_compress_on_upload = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_conversion_address_space_limit = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_conversion_cpu_limit = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_conversion_disable = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_upload_use_cinder_backend = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_upload_use_internal_tenant = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_volume_cache_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_volume_cache_max_count = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] image_volume_cache_max_size_gb = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] init_host_max_objects_retrieval = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] instance_format = [instance: %(uuid)s] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] iscsi_target_flags = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] iscsi_write_cache = on {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] iser_helper = tgtadm {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] iser_ip_address = 192.168.122.129 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] iser_port = 3260 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_color = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_config_append = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_dir = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_file = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_options = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_rotate_interval = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_rotate_interval_type = days {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] log_rotation_type = none {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 02 00:38:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.remotefs [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86591) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] max_age = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] max_logfile_count = 30 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] max_logfile_size_mb = 200 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] max_over_subscription_ratio = 20.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] message_reap_interval = 86400 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] message_ttl = 2592000 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] migration_create_volume_timeout_secs = 300 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] monkey_patch = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] monkey_patch_modules = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] my_ip = 192.168.122.129 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] no_snapshot_gb_quota = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] num_iser_scan_tries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] num_shell_tries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] num_volume_device_scan_tries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] nvmeof_conn_info_version = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] nvmet_ns_id = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] nvmet_port_id = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] osapi_max_limit = 1000 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] osapi_volume_ext_list = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] osapi_volume_listen = 0.0.0.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] osapi_volume_listen_port = 8776 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] osapi_volume_use_ssl = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] osapi_volume_workers = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] per_volume_size_limit = -1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] periodic_fuzzy_delay = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] periodic_interval = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] project_id_regex = [0-9a-f\-]+ {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] public_endpoint = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] publish_errors = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] quota_backup_gigabytes = 1000 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] quota_backups = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] quota_gigabytes = 1000 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] quota_groups = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] quota_snapshots = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] quota_volumes = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] rate_limit_burst = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] rate_limit_except_level = CRITICAL {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] rate_limit_interval = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] reinit_driver_count = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] replication_device = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] report_discard_supported = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] report_interval = 120 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] reservation_clean_interval = 86400 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] reservation_expire = 86400 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] reserved_image_namespaces = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] reserved_percentage = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] rpc_response_timeout = 120 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] run_external_periodic_tasks = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] scst_target_driver = iscsi {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] scst_target_iqn_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_down_time = 720 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] shell_completion = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] snapshot_name_template = snapshot-%s {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] split_loggers = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] state_path = /opt/stack/data/cinder {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] storage_availability_zone = nova {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] storage_protocol = iSCSI {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] syslog_log_facility = LOG_USER {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] target_helper = lioadm {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] target_ip_address = 192.168.122.129 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] target_port = 3260 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] target_protocol = iscsi {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] target_secondary_ip_addresses = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] trace_flags = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] transfer_api_class = cinder.transfer.api.API {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] transport_url = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] until_refresh = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] use_chap_auth = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] use_default_quota_class = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] use_journal = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] use_json = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] use_multipath_for_image_xfer = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] use_stderr = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] use_syslog = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] verify_glance_signatures = enabled {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_api_class = cinder.volume.api.API {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_backend_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_clear = zero {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_clear_ionice = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_clear_size = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_copy_bps_limit = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_dd_blocksize = 1M {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_name_template = volume-%s {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_service_inithost_offload = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volume_usage_audit_period = month {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] zoning_mode = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_concurrency.disable_process_locking = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.auth_section = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.auth_type = password {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.auth_version = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.cache = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.delay_auth_decision = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.http_connect_timeout = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.include_service_catalog = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.insecure = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.interface = public {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_password = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcache_username = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.region_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.service_token_roles_required = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.service_type = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.token_cache_time = 300 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.backend = dogpile.cache.null {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.backend_argument = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.backend_expiration_time = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.config_prefix = cache.oslo {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.debug_cache_backend = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.enable_retry_client = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.enable_socket_keepalive = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.expiration_time = 600 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.hashclient_retry_attempts = 2 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.memcache_dead_retry = 300 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86591) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 02 00:38:05 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 02 00:38:05 devstack cinder-volume[86591]: WARNING cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 02 00:38:05 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Running cmd (subprocess): mount.quobyte {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.memcache_pool_maxsize = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.memcache_sasl_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.password = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.proxies = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.redis_db = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.redis_sentinel_service_name = mymaster {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.redis_server = localhost:6379 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.retry_attempts = 2 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.retry_delay = 0.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.socket_keepalive_count = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.socket_keepalive_idle = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.socket_keepalive_interval = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.socket_timeout = 1.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.tls_allowed_ciphers = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.tls_cafile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.tls_certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.tls_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.tls_keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cache.username = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] coordination.backend_url = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.asyncio_connection = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.asyncio_slave_connection = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.backend = sqlalchemy {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.connection = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.connection_debug = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.connection_parameters = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.connection_recycle_time = 3600 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.connection_trace = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.db_inc_retry_interval = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.db_max_retries = 20 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.db_max_retry_interval = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.db_retry_interval = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.max_overflow = 50 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.max_pool_size = 5 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.max_retries = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.mysql_wsrep_sync_wait = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.pool_timeout = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.retry_interval = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.slave_connection = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.sqlite_synchronous = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.synchronous_reader = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] database.use_db_reconnect = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_tracing.insecure = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.connection_string = messaging:// {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.es_doc_type = notification {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.es_scroll_size = 10000 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.es_scroll_time = 2m {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.filter_error_trace = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.hmac_keys = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.sentinel_service_name = mymaster {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.socket_timeout = 0.1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.trace_requests = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler.trace_sqlalchemy = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler_jaeger.process_tags = {} {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler_jaeger.service_name_prefix = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] profiler_otlp.service_name_prefix = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.enforce_new_defaults = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.policy_default_rule = default {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.policy_file = policy.yaml {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_policy.remote_timeout = 60.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] privsep_osbrick.group = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] privsep_osbrick.helper_command = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] privsep_osbrick.user = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_sys_admin.group = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_sys_admin.helper_command = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] cinder_sys_admin.user = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.auth_section = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.auth_type = password {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.cafile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.collect_timing = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.insecure = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.send_service_user_token = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.split_loggers = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.timeout = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.tls_ciphers = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] service_user.tls_min_version = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.auth_section = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.auth_type = password {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.collect_timing = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.insecure = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.region_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.split_loggers = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.timeout = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.tls_ciphers = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] glance.tls_min_version = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.backend_availability_zone = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.chap_password = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.chap_username = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.disk_geometry = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.driver_client_cert = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.driver_client_cert_key = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.driver_data_namespace = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.driver_use_ssl = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.enable_unsupported_driver = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.extra_capabilities = {} {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.filter_function = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.goodness_function = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.iscsi_target_flags = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.iscsi_write_cache = on {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.iser_helper = tgtadm {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.iser_port = 3260 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_host = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_login = admin {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_mount_options = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_password = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_private_key = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_share_path = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_ssh_port = 22 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.num_shell_tries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.nvmet_port_id = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.quobyte_client_cfg = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.quobyte_volume_url = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.replication_device = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.report_discard_supported = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.reserved_percentage = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.scst_target_driver = iscsi {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.scst_target_iqn_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.storage_protocol = iSCSI {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.target_helper = tgtadm {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.target_port = 3260 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.target_protocol = iscsi {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.trace_flags = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.unique_fqdn_network = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.use_chap_auth = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_backend_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_clear = zero {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_clear_ionice = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_clear_size = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_reports.file_event_handler = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_reports.log_dir = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.backend_availability_zone = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.backend_host = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.chap_password = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.chap_username = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.chiscsi_conf = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.disk_geometry = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.driver_client_cert = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.driver_client_cert_key = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.driver_data_namespace = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.driver_use_ssl = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.extra_capabilities = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.filter_function = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.goodness_function = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.iscsi_target_flags = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.iscsi_write_cache = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.iser_helper = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.iser_ip_address = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.iser_port = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.iser_target_prefix = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_host = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_login = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_mount_options = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_password = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_private_key = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_share_path = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_ssh_port = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.num_shell_tries = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nvmet_ns_id = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.nvmet_port_id = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.replication_device = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.report_discard_supported = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.reserved_percentage = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.scst_target_driver = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.storage_protocol = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.target_helper = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.target_ip_address = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.target_port = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.target_prefix = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.target_protocol = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.trace_flags = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.unique_fqdn_network = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.use_chap_auth = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack quobyte-client[86592]: Reading configuration file: /etc/quobyte/client.cfg Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_clear = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_clear_ionice = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_clear_size = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:05 devstack quobyte-client[86592]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] QuobyteHD.volumes_dir = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.ssl = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.ssl_version = {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_notifications.driver = [] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_notifications.retry = -1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] oslo_messaging_notifications.transport_url = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] key_manager.fixed_key = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.barbican_api_version = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.barbican_endpoint = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.barbican_endpoint_type = public {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.barbican_region_name = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.cafile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.collect_timing = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.insecure = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.number_of_retries = 60 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.retry_delay = 1 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.send_service_user_token = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.split_loggers = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.timeout = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.tls_ciphers = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.tls_min_version = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.verify_ssl = True {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican.verify_ssl_path = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.auth_section = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.auth_type = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.cafile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.certfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.collect_timing = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.insecure = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.keyfile = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.split_loggers = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.timeout = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.tls_ciphers = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] barbican_service_user.tls_min_version = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.approle_role_id = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.approle_secret_id = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.auth_method = approle {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 ... Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 -c /etc/quobyte/client-cinder.cfg {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.auth_path = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.kv_mountpoint = secret {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.kv_path = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.kv_version = 2 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.namespace = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.root_token_id = **** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.ssl_ca_crt_file = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.timeout = 60.0 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.token_file = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.token_role = None {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.use_ssl = False {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:06 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] ******************************************************************************** {{(pid=86375) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 00:38:06 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 -c /etc/quobyte/client-cinder.cfg Sep 02 00:38:06 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:06 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.389s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:06 devstack cinder-volume[86591]: INFO cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 succeeded Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.412s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:06 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:38:06 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:06 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.241s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:06 devstack cinder-volume[86591]: INFO cinder.volume.driver [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Driver hasn't implemented _init_vendor_properties() Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG cinder.volume.driver [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9354515075684, 'free_capacity_gb': 1773.9354515075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86591) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_db.sqlalchemy.engines [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writer thread running {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG cinder.db.api [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Building query based on filter {{(pid=86591) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG cinder.image.image_utils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86591) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 00:38:06 devstack cinder-volume[86591]: INFO cinder.keymgr.migration [None req-33e102d1-f996-48a8-82b1-ca0042f222e1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:38:06 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:06 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:38:06 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:07 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.256s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:38:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Driver initialization completed successfully. Sep 02 00:38:07 devstack cinder-volume[86591]: INFO cinder.manager [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Initiating service 3 cleanup Sep 02 00:38:07 devstack cinder-volume[86591]: INFO cinder.manager [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Service 3 cleanup completed. Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG cinder.service [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Creating RPC server for service cinder-volume {{(pid=86591) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG cinder.service [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86591) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 00:38:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:07 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:38:07 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:07 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:07 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.342s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:07 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-941ba5ef-36ce-4b5a-9688-6c6c347cf19c None None] Driver post RPC initialization completed successfully. Sep 02 00:38:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:38:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:38:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=86591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:38:11 devstack cinder-volume[86591]: DEBUG cinder.volume.drivers.quobyte [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=86591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:38:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:38:11 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:11 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:38:11 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:12 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:12 devstack cinder-volume[86591]: DEBUG oslo_concurrency.processutils [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.221s {{(pid=86591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:12 devstack cinder-volume[86591]: DEBUG cinder.manager [None req-1b1a37c3-6f08-411e-9c2f-7606ef50a454 None None] Notifying Schedulers of capabilities ... {{(pid=86591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:38:15 devstack cinder-volume[86375]: INFO oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Caught SIGTERM, stopping children Sep 02 00:38:15 devstack cinder-volume[86375]: DEBUG oslo_concurrency.lockutils [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Acquiring lock "singleton_lock" {{(pid=86375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 00:38:15 devstack cinder-volume[86375]: DEBUG oslo_concurrency.lockutils [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Acquired lock "singleton_lock" {{(pid=86375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 00:38:15 devstack cinder-volume[86375]: DEBUG oslo_concurrency.lockutils [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Releasing lock "singleton_lock" {{(pid=86375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 00:38:15 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Stop services. {{(pid=86375) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 02 00:38:15 devstack cinder-volume[86375]: DEBUG oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Killing children. {{(pid=86375) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 02 00:38:15 devstack cinder-volume[86375]: INFO oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Waiting on 1 children to exit Sep 02 00:38:17 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:38:17 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:38:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Acquiring lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 00:38:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Acquired lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 00:38:20 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Releasing lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 00:38:20 devstack cinder-volume[86591]: WARNING amqp [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 00:38:20 devstack cinder-volume[86591]: WARNING amqp [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 02 00:38:20 devstack cinder-volume[86375]: INFO oslo_service.backend._eventlet.service [None req-f73a9d21-2233-4cf5-a6ce-30eb662481ca None None] Child 86591 exited with status 0 Sep 02 00:38:21 devstack cinder-volume[86941]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 02 00:38:21 devstack cinder-volume[86941]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 00:38:21 devstack cinder-volume[86941]: we strongly recommend against using it for new projects. Sep 02 00:38:21 devstack cinder-volume[86941]: If you are already using Eventlet, we recommend migrating to a different Sep 02 00:38:21 devstack cinder-volume[86941]: framework. For more detail see Sep 02 00:38:21 devstack cinder-volume[86941]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 00:38:21 devstack cinder-volume[86941]: import eventlet # noqa Sep 02 00:38:23 devstack cinder-volume[86941]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 02 00:38:23 devstack cinder-volume[86941]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 02 00:38:23 devstack cinder-volume[86941]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 02 00:38:24 devstack cinder-volume[86941]: INFO dbcounter [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Registered counter for database cinder Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_db.sqlalchemy.engines [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG dbcounter [-] [86941] Writer thread running {{(pid=86941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 00:38:24 devstack cinder-volume[86941]: INFO cinder.rpc [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 02 00:38:24 devstack cinder-volume[86941]: INFO cinder.rpc [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_db.sqlalchemy.engines [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:24 devstack cinder-volume[86941]: INFO cinder.volume.manager [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Determined volume DB was empty at startup. Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG cinder.volume.manager [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86941) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 02 00:38:24 devstack cinder-volume[86941]: WARNING stevedore.named [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 02 00:38:24 devstack cinder-volume[86941]: WARNING castellan.key_manager [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 00:38:24 devstack cinder-volume[86941]: WARNING cinder.keymgr.conf_key_mgr [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 02 00:38:24 devstack cinder-volume[86941]: INFO cinder.volume.manager [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_db.sqlalchemy.engines [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:24 devstack cinder-volume[86941]: INFO oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Starting 1 workers Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Started child 87232 {{(pid=86941) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Full set of CONF: {{(pid=86941) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] ******************************************************************************** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] Configuration options gathered from: {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] ================================================================================ {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] allow_availability_zone_fallback = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] allow_compression_on_image_upload = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[87232]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] allowed_direct_url_schemes = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] api_rate_limit = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] auth_strategy = keystone {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_availability_zone = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_host = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_stats_polling_interval = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backup_api_class = cinder.backup.api.API {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backup_name_template = backup-%s {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backup_use_same_host = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backup_use_temp_snapshot = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] chap_password = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] chap_username = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_internal_tenant_project_id = 70bb5e3d15484e128936aceb4d264bc7 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_internal_tenant_user_id = 10fd85a3f7e04324bb5cc9f962f1e956 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cluster = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] compression_format = gzip {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] compute_api_class = cinder.compute.nova.API {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] config_dir = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] config_source = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] control_exchange = openstack {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] debug = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] default_availability_zone = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] default_group_type = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] default_volume_type = QuobyteHD {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] disk_geometry = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] driver_client_cert = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] driver_client_cert_key = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] driver_data_namespace = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] driver_ssl_cert_path = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] driver_ssl_cert_verify = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] driver_use_ssl = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] enable_new_services = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] enable_unsupported_driver = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] enabled_backends = ['QuobyteHD'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] enforce_multipath_for_image_xfer = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] filter_function = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_api_insecure = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_api_servers = ['http://192.168.122.129/image'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_api_ssl_compression = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_ca_certificates_file = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_catalog_info = image:glance:publicURL {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_num_retries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance_request_timeout = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] goodness_function = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] graceful_shutdown_timeout = 5 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] group_api_class = cinder.group.api.API {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] host = devstack {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_compress_on_upload = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_conversion_address_space_limit = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_conversion_cpu_limit = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_conversion_disable = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_upload_use_cinder_backend = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_upload_use_internal_tenant = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_volume_cache_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_volume_cache_max_count = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] image_volume_cache_max_size_gb = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] init_host_max_objects_retrieval = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] instance_format = [instance: %(uuid)s] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] iscsi_target_flags = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] iscsi_write_cache = on {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] iser_helper = tgtadm {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] iser_ip_address = 192.168.122.129 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] iser_port = 3260 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_color = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_config_append = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_dir = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_file = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_options = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_rotate_interval = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_rotate_interval_type = days {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] log_rotation_type = none {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] max_age = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] max_logfile_count = 30 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] max_logfile_size_mb = 200 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] max_over_subscription_ratio = 20.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] message_reap_interval = 86400 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] message_ttl = 2592000 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] migration_create_volume_timeout_secs = 300 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] monkey_patch = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] monkey_patch_modules = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] my_ip = 192.168.122.129 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] no_snapshot_gb_quota = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] num_iser_scan_tries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87232) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] num_shell_tries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] num_volume_device_scan_tries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] nvmeof_conn_info_version = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] nvmet_ns_id = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] nvmet_port_id = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] osapi_max_limit = 1000 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] osapi_volume_ext_list = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] osapi_volume_listen_port = 8776 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] osapi_volume_use_ssl = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] osapi_volume_workers = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] per_volume_size_limit = -1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] periodic_fuzzy_delay = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] periodic_interval = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] public_endpoint = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] publish_errors = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] quota_backup_gigabytes = 1000 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] quota_backups = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] quota_gigabytes = 1000 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] quota_groups = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] quota_snapshots = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] quota_volumes = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] rate_limit_burst = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] rate_limit_except_level = CRITICAL {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] rate_limit_interval = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] reinit_driver_count = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] replication_device = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] report_discard_supported = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] report_interval = 120 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] reservation_clean_interval = 86400 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] reservation_expire = 86400 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] reserved_image_namespaces = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] reserved_percentage = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] rpc_response_timeout = 120 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] run_external_periodic_tasks = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] scst_target_driver = iscsi {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] scst_target_iqn_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_down_time = 720 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] shell_completion = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] snapshot_name_template = snapshot-%s {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] split_loggers = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] state_path = /opt/stack/data/cinder {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] storage_availability_zone = nova {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] storage_protocol = iSCSI {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] syslog_log_facility = LOG_USER {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] target_helper = lioadm {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] target_ip_address = 192.168.122.129 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] target_port = 3260 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] target_protocol = iscsi {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] target_secondary_ip_addresses = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] trace_flags = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] transport_url = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] until_refresh = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] use_chap_auth = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] use_default_quota_class = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] use_journal = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] use_json = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] use_multipath_for_image_xfer = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] use_stderr = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] use_syslog = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] verify_glance_signatures = enabled {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_api_class = cinder.volume.api.API {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_backend_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_clear = zero {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_clear_ionice = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_clear_size = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_copy_bps_limit = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_dd_blocksize = 1M {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_name_template = volume-%s {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_service_inithost_offload = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volume_usage_audit_period = month {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] zoning_mode = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_concurrency.disable_process_locking = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.auth_section = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.auth_type = password {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.auth_version = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.cache = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.include_service_catalog = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.insecure = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.interface = public {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_password = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcache_username = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.region_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.service_type = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.129/identity {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.backend = dogpile.cache.null {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.backend_argument = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.backend_expiration_time = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.config_prefix = cache.oslo {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.debug_cache_backend = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.enable_retry_client = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.enable_socket_keepalive = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.expiration_time = 600 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.hashclient_retry_attempts = 2 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.memcache_dead_retry = 300 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.memcache_pool_maxsize = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:24 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.memcache_sasl_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.password = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.proxies = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.redis_db = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.redis_server = localhost:6379 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.retry_attempts = 2 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.retry_delay = 0.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.socket_keepalive_count = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.socket_keepalive_idle = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.socket_keepalive_interval = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.socket_timeout = 1.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.tls_allowed_ciphers = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.tls_cafile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87232) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.tls_certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.tls_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.tls_keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cache.username = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] coordination.backend_url = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.asyncio_connection = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Running cmd (subprocess): mount.quobyte {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.asyncio_slave_connection = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.backend = sqlalchemy {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.connection = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.connection_debug = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.connection_parameters = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.connection_recycle_time = 3600 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.connection_trace = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.db_inc_retry_interval = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.db_max_retries = 20 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.db_max_retry_interval = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.db_retry_interval = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.max_overflow = 50 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.max_pool_size = 5 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.max_retries = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.mysql_wsrep_sync_wait = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.pool_timeout = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.retry_interval = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.slave_connection = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.sqlite_synchronous = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.synchronous_reader = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] database.use_db_reconnect = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_tracing.insecure = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.connection_string = messaging:// {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.es_doc_type = notification {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.es_scroll_size = 10000 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.es_scroll_time = 2m {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.filter_error_trace = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.hmac_keys = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.sentinel_service_name = mymaster {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.socket_timeout = 0.1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.trace_requests = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler.trace_sqlalchemy = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler_jaeger.process_tags = {} {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler_jaeger.service_name_prefix = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] profiler_otlp.service_name_prefix = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.enforce_new_defaults = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.policy_default_rule = default {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.policy_file = policy.yaml {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] privsep_osbrick.group = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] privsep_osbrick.helper_command = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] privsep_osbrick.user = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_sys_admin.group = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_sys_admin.helper_command = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] cinder_sys_admin.user = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.auth_section = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.auth_type = password {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.cafile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.collect_timing = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.insecure = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.send_service_user_token = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.split_loggers = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.timeout = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.tls_ciphers = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] service_user.tls_min_version = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.auth_section = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.auth_type = password {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.collect_timing = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.insecure = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.region_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.split_loggers = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.timeout = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.tls_ciphers = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] glance.tls_min_version = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.backend_availability_zone = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.chap_password = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.chap_username = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.disk_geometry = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.driver_client_cert = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.driver_client_cert_key = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.driver_data_namespace = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.driver_use_ssl = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.extra_capabilities = {} {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.filter_function = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.goodness_function = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.iscsi_target_flags = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.iscsi_write_cache = on {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.iser_helper = tgtadm {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.iser_ip_address = 192.168.122.129 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.iser_port = 3260 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_host = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_login = admin {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_mount_options = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_password = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_private_key = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_share_path = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.num_shell_tries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.quobyte_volume_url = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack quobyte-client[87238]: Reading configuration file: /etc/quobyte/client.cfg Sep 02 00:38:25 devstack quobyte-client[87238]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.replication_device = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.report_discard_supported = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.reserved_percentage = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.target_helper = tgtadm {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.target_ip_address = 192.168.122.129 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.target_port = 3260 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.target_protocol = iscsi {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.trace_flags = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.unique_fqdn_network = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.use_chap_auth = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_backend_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_clear = zero {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_clear_ionice = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_clear_size = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_reports.file_event_handler = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_reports.log_dir = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.backend_availability_zone = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.backend_host = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.chap_password = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.chap_username = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.chiscsi_conf = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.disk_geometry = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.driver_client_cert = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.driver_data_namespace = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.driver_use_ssl = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.extra_capabilities = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.filter_function = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.goodness_function = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.iser_helper = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.iser_ip_address = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.iser_port = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.iser_target_prefix = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_host = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_login = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_mount_options = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_password = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_private_key = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_share_path = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_ssh_port = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.num_shell_tries = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.nvmet_port_id = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.replication_device = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.report_discard_supported = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.reserved_percentage = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.scst_target_driver = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.storage_protocol = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.target_helper = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.target_ip_address = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.target_port = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.target_prefix = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.target_protocol = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.trace_flags = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.use_chap_auth = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_clear = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_clear_size = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] QuobyteHD.volumes_dir = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.ssl = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_notifications.driver = [] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_notifications.retry = -1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] key_manager.fixed_key = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.barbican_api_version = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.barbican_endpoint = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.barbican_endpoint_type = public {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.barbican_region_name = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.cafile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.collect_timing = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.insecure = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.number_of_retries = 60 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.retry_delay = 1 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.send_service_user_token = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.split_loggers = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.timeout = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.tls_ciphers = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.tls_min_version = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.verify_ssl = True {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican.verify_ssl_path = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.auth_section = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.auth_type = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.cafile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.certfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.collect_timing = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.insecure = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.keyfile = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.split_loggers = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.timeout = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.tls_ciphers = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] barbican_service_user.tls_min_version = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.approle_role_id = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.approle_secret_id = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.auth_method = approle {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.auth_path = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.kv_mountpoint = secret {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.kv_path = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.kv_version = 2 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.namespace = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.root_token_id = **** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.ssl_ca_crt_file = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.timeout = 60.0 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.token_file = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.token_role = None {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.use_ssl = False {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 02 00:38:25 devstack cinder-volume[86941]: DEBUG oslo_service.backend._eventlet.service [None req-ab8b9e69-4b00-474c-8c58-28741b92e63d None None] ******************************************************************************** {{(pid=86941) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 02 00:38:25 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:25 devstack cinder-volume[87232]: INFO cinder.volume.driver [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Driver hasn't implemented _init_vendor_properties() Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.driver [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9354515075684, 'free_capacity_gb': 1773.9354515075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_db.sqlalchemy.engines [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writer thread running {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.db.api [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Building query based on filter {{(pid=87232) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87232) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:25 devstack cinder-volume[87232]: INFO cinder.keymgr.migration [None req-4ad69064-67df-4662-817b-4358c994fa65 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 02 00:38:25 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:38:25 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:25 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.230s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:38:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Driver initialization completed successfully. Sep 02 00:38:25 devstack cinder-volume[87232]: INFO cinder.manager [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Initiating service 3 cleanup Sep 02 00:38:25 devstack cinder-volume[87232]: INFO cinder.manager [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Service 3 cleanup completed. Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.service [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Creating RPC server for service cinder-volume {{(pid=87232) start /opt/stack/cinder/cinder/service.py:231}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.service [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87232) start /opt/stack/cinder/cinder/service.py:237}} Sep 02 00:38:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:38:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:38:25 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:38:25 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:38:26 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Sep 02 00:38:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.244s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:38:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eb467c83-0dba-4e90-97cf-9f4bd3655958 None None] Driver post RPC initialization completed successfully. Sep 02 00:38:34 devstack cinder-volume[86941]: DEBUG dbcounter [-] [86941] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:38:35 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:38:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:39:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:39:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 6 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:39:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Flow 'volume_create_manager' (aa2e28fe-908e-4ca5-97d5-0f5eec682341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d141e8b-2562-4f99-9591-04bb4a073b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d141e8b-2562-4f99-9591-04bb4a073b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-330898715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cfb5f3-252e-4146-879a-46ec9115a31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9fdb5cddf1473bb4b36965c265b5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:39:57Z,use_quota=True,user_id='d127c6ca841d403a83bf0a4f828de96f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c83fd6-7a67-43e4-94df-e2dfb18c3e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c83fd6-7a67-43e4-94df-e2dfb18c3e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897c962e-5826-47e2-94ba-8f63795ef210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897c962e-5826-47e2-94ba-8f63795ef210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5cfb5f3-252e-4146-879a-46ec9115a31c', 'volume_name': 'volume-c5cfb5f3-252e-4146-879a-46ec9115a31c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8729bc63-5f0c-4d36-adf4-3f7536450352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8729bc63-5f0c-4d36-adf4-3f7536450352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757d0d44-a89e-4479-9a58-1073cd002915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Volume c5cfb5f3-252e-4146-879a-46ec9115a31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5cfb5f3-252e-4146-879a-46ec9115a31c', 'volume_size': 1} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-330898715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cfb5f3-252e-4146-879a-46ec9115a31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb9fdb5cddf1473bb4b36965c265b5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:39:57Z,use_quota=True,user_id='d127c6ca841d403a83bf0a4f828de96f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Creating volume c5cfb5f3-252e-4146-879a-46ec9115a31c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:39:57 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:39:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:39:57 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c 1073741824 Sep 02 00:39:57 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Flow 'volume_create_manager' (51c5bdce-a7ba-4c5e-8c5b-401b48b764d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c4be9d-1e3d-4304-a7c1-23d1dbea0588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c4be9d-1e3d-4304-a7c1-23d1dbea0588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-759719557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c61630c-3349-4d46-98b8-c399dd0d62f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ea25b3324492f907fdd97ea6aae80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:39:58Z,use_quota=True,user_id='55ee0d4e5f7b41119ee1983a2122e0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2433d462-5e87-429c-a628-7fad2ca664ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2433d462-5e87-429c-a628-7fad2ca664ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b4203c-e320-454a-91f6-579f5a78e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b4203c-e320-454a-91f6-579f5a78e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c61630c-3349-4d46-98b8-c399dd0d62f8', 'volume_name': 'volume-4c61630c-3349-4d46-98b8-c399dd0d62f8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e50482c-8505-4d04-8e8e-d61553cf5d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e50482c-8505-4d04-8e8e-d61553cf5d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2646629e-590d-4d80-a554-e323e22d6e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Volume 4c61630c-3349-4d46-98b8-c399dd0d62f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c61630c-3349-4d46-98b8-c399dd0d62f8', 'volume_size': 1} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:39:58 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c 1073741824" returned: 0 in 1.201s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:39:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:39:58 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c Sep 02 00:39:58 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:39:59 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-759719557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c61630c-3349-4d46-98b8-c399dd0d62f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='789ea25b3324492f907fdd97ea6aae80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:39:58Z,use_quota=True,user_id='55ee0d4e5f7b41119ee1983a2122e0fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Creating volume 4c61630c-3349-4d46-98b8-c399dd0d62f8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:39:59 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757d0d44-a89e-4479-9a58-1073cd002915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5cfb5f3-252e-4146-879a-46ec9115a31c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b4f814-f246-4863-bb7b-c0fd5d321011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:39:59 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 1073741824 Sep 02 00:39:59 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:39:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Volume volume-c5cfb5f3-252e-4146-879a-46ec9115a31c (c5cfb5f3-252e-4146-879a-46ec9115a31c): created successfully Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b4f814-f246-4863-bb7b-c0fd5d321011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Flow 'volume_create_manager' (aa2e28fe-908e-4ca5-97d5-0f5eec682341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:39:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c488c444-d8ea-4e63-a55f-683b147d4846 tempest-ServerRescueNegativeTestJSON-1276782469 None] Created volume successfully. Sep 02 00:39:59 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Sep 02 00:39:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 1073741824" returned: 0 in 0.779s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:00 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 Sep 02 00:40:00 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:00 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8" returned: 0 in 0.611s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2646629e-590d-4d80-a554-e323e22d6e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c61630c-3349-4d46-98b8-c399dd0d62f8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39629643-4039-4eb4-94a1-4a6bede70bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Volume volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 (4c61630c-3349-4d46-98b8-c399dd0d62f8): created successfully Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39629643-4039-4eb4-94a1-4a6bede70bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Flow 'volume_create_manager' (51c5bdce-a7ba-4c5e-8c5b-401b48b764d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:40:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c8c8eb53-23e8-45bc-87bb-660ecec99f82 tempest-VolumesAdminNegativeTest-680808792 None] Created volume successfully. Sep 02 00:40:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Acquiring lock "cinder-4c61630c-3349-4d46-98b8-c399dd0d62f8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:40:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Lock "cinder-4c61630c-3349-4d46-98b8-c399dd0d62f8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:40:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Acquiring lock "cinder-quobyte-4c61630c-3349-4d46-98b8-c399dd0d62f8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:40:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Lock "cinder-quobyte-4c61630c-3349-4d46-98b8-c399dd0d62f8" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:40:03 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphb1jalrw/privsep.sock'] Sep 02 00:40:03 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphb1jalrw/privsep.sock Sep 02 00:40:03 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: Sep 02 00:40:04 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 02 00:40:05 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:05 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Spawned new privsep daemon via rootwrap Sep 02 00:40:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Accepted privsep connection to /tmp/tmphb1jalrw/privsep.sock {{(pid=87232) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 02 00:40:05 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 02 00:40:05 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 02 00:40:05 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 02 00:40:05 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88545 Sep 02 00:40:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f24e8-7e77-4cea-9be1-73233e930fb0]: (2,) {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:40:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f11f5-2ff5-4c2f-9fc9-f823db8cc0c5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:40:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:05 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 Sep 02 00:40:05 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:06 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8" returned: 0 in 0.805s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:06 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8 Sep 02 00:40:06 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:06 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4c61630c-3349-4d46-98b8-c399dd0d62f8" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Lock "cinder-quobyte-4c61630c-3349-4d46-98b8-c399dd0d62f8" released by "delete_volume" :: held 3.863s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:40:06 devstack cinder-volume[87232]: WARNING cinder.quota [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:40:06 devstack cinder-volume[87232]: WARNING cinder.quota [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:40:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Created reservations ['ce5a80ca-7286-4bb8-81a1-3c3349058c59', 'e96e9b86-b647-4e43-8bd9-722cbb735da0', '0fc92fd9-f8f2-4b66-9c1e-43d393fb4d30', '80e808e7-2915-49b2-9b32-8046fdb7dc0b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:40:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:40:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:40:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:07 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:40:07 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:07 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.695s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:40:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Deleted volume successfully. Sep 02 00:40:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77bae5b-b4f0-4df9-b740-9e91b27eea4c tempest-VolumesAdminNegativeTest-680808792 None] Lock "cinder-4c61630c-3349-4d46-98b8-c399dd0d62f8-delete_volume" released by "delete_volume" :: held 5.295s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:12 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:40:12 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:12 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.703s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 8 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:40:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:40:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Acquiring lock "cinder-c5cfb5f3-252e-4146-879a-46ec9115a31c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:40:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "cinder-c5cfb5f3-252e-4146-879a-46ec9115a31c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:40:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Acquiring lock "cinder-quobyte-c5cfb5f3-252e-4146-879a-46ec9115a31c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:40:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "cinder-quobyte-c5cfb5f3-252e-4146-879a-46ec9115a31c" acquired by "delete_volume" :: waited 0.045s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:40:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f104d5-a2bc-424e-93fa-126351db38e8]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:40:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:14 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c Sep 02 00:40:14 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:15 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c" returned: 0 in 0.707s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:15 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c Sep 02 00:40:15 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:15 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c5cfb5f3-252e-4146-879a-46ec9115a31c" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "cinder-quobyte-c5cfb5f3-252e-4146-879a-46ec9115a31c" released by "delete_volume" :: held 1.228s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Created reservations ['ada3096f-437b-4bca-8a0f-9e4aaa20a446', '436f507e-f30c-463b-9a24-e64f57f13046', '2ffb5499-b57c-40ca-a89a-b286e4c47911', 'ec009655-fa03-41ef-bc10-554ab7743474'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:16 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:40:16 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:16 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:40:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Deleted volume successfully. Sep 02 00:40:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69d7674d-8f5c-4b1c-be27-f087190760f8 tempest-ServerRescueNegativeTestJSON-1276782469 None] Lock "cinder-c5cfb5f3-252e-4146-879a-46ec9115a31c-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Flow 'volume_create_manager' (b124b9e6-8914-4761-a306-a7c8733f92fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d77b16e-476d-46c9-8e10-cb4a51586bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d77b16e-476d-46c9-8e10-cb4a51586bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1430963823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7193b14-5aaf-4d9d-bfbe-6999d54070c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647582f9f1b84cbfadde14b791a3f1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:40:18Z,use_quota=True,user_id='79d3e994db2846b1b8a482454c13ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4086745-8d4e-4648-8263-74a51824b8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4086745-8d4e-4648-8263-74a51824b8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e2be84-53b9-4421-b31f-937e7e5a0ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e2be84-53b9-4421-b31f-937e7e5a0ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7193b14-5aaf-4d9d-bfbe-6999d54070c1', 'volume_name': 'volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb2b668-104f-4322-81fb-a14cc4cfb184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb2b668-104f-4322-81fb-a14cc4cfb184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f1ee0a-b72b-4244-9fcc-12f22c3ddc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Volume a7193b14-5aaf-4d9d-bfbe-6999d54070c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1', 'volume_size': 1} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1430963823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7193b14-5aaf-4d9d-bfbe-6999d54070c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647582f9f1b84cbfadde14b791a3f1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:40:18Z,use_quota=True,user_id='79d3e994db2846b1b8a482454c13ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Creating volume a7193b14-5aaf-4d9d-bfbe-6999d54070c1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:40:18 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:18 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 1073741824 Sep 02 00:40:18 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:18 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 1073741824" returned: 0 in 0.737s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:19 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 Sep 02 00:40:19 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:19 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f1ee0a-b72b-4244-9fcc-12f22c3ddc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867953cc-7ec1-4c44-9a79-c49c7b68a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:19 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Volume volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 (a7193b14-5aaf-4d9d-bfbe-6999d54070c1): created successfully Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867953cc-7ec1-4c44-9a79-c49c7b68a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Flow 'volume_create_manager' (b124b9e6-8914-4761-a306-a7c8733f92fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:40:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a317c20c-d654-4d03-91ed-e7bfa5998a42 tempest-AttachVolumeTestJSON-2070218218 None] Created volume successfully. Sep 02 00:40:24 devstack cinder-volume[87232]: WARNING py.warnings [req-c2ae3fda-d94e-4125-aff6-c04f81e2ac2b req-6597dced-e240-42be-93d5-da4aee2018a6 tempest-AttachVolumeTestJSON-2070218218 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 02 00:40:24 devstack cinder-volume[87232]: .first() Sep 02 00:40:24 devstack cinder-volume[87232]: Sep 02 00:40:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c2ae3fda-d94e-4125-aff6-c04f81e2ac2b req-6597dced-e240-42be-93d5-da4aee2018a6 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c2ae3fda-d94e-4125-aff6-c04f81e2ac2b req-6597dced-e240-42be-93d5-da4aee2018a6 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c2ae3fda-d94e-4125-aff6-c04f81e2ac2b req-6597dced-e240-42be-93d5-da4aee2018a6 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-c2ae3fda-d94e-4125-aff6-c04f81e2ac2b req-6597dced-e240-42be-93d5-da4aee2018a6 tempest-AttachVolumeTestJSON-2070218218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '883f0287-e144-4126-bc58-691c12822154', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:40:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-c2ae3fda-d94e-4125-aff6-c04f81e2ac2b req-6597dced-e240-42be-93d5-da4aee2018a6 tempest-AttachVolumeTestJSON-2070218218 None] attachment_update completed successfully. Sep 02 00:40:35 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:40:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=20,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Flow 'volume_create_manager' (2d8bf3ae-d0c7-4844-b88e-165d9e5bf669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36e7141-ca92-4335-a840-bdba6eeedafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36e7141-ca92-4335-a840-bdba6eeedafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1626068039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd5b2f7-8c1f-4ca7-b934-deed58c12176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c158563175415badad10ff3493d574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:40:41Z,use_quota=True,user_id='43c9d70df35f46a5ad1fb1a8c4dd1046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1ee3a7-f15e-4c83-a769-d818978124c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1ee3a7-f15e-4c83-a769-d818978124c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93caf2d-171a-476a-9dcc-bb3ed47a91db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93caf2d-171a-476a-9dcc-bb3ed47a91db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd5b2f7-8c1f-4ca7-b934-deed58c12176', 'volume_name': 'volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d760afe7-47c6-4fe9-a1a9-c317d2340e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d760afe7-47c6-4fe9-a1a9-c317d2340e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dcf650-81fe-4057-84c4-2111eef7eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Volume 2fd5b2f7-8c1f-4ca7-b934-deed58c12176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176', 'volume_size': 1} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1626068039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd5b2f7-8c1f-4ca7-b934-deed58c12176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c158563175415badad10ff3493d574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:40:41Z,use_quota=True,user_id='43c9d70df35f46a5ad1fb1a8c4dd1046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Creating volume 2fd5b2f7-8c1f-4ca7-b934-deed58c12176 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:40:41 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:40:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:41 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 1073741824 Sep 02 00:40:41 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:42 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 1073741824" returned: 0 in 1.076s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:42 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 Sep 02 00:40:42 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:42 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176" returned: 0 in 0.397s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dcf650-81fe-4057-84c4-2111eef7eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dc5c10-ae52-4d35-aadd-fe7e3ae7e899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:40:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Volume volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 (2fd5b2f7-8c1f-4ca7-b934-deed58c12176): created successfully Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dc5c10-ae52-4d35-aadd-fe7e3ae7e899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:40:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Flow 'volume_create_manager' (2d8bf3ae-d0c7-4844-b88e-165d9e5bf669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:40:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-64ecd243-5d67-4e2e-988b-14c672655603 tempest-DeleteServersTestJSON-1707743062 None] Created volume successfully. Sep 02 00:40:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-70de95fb-aec9-4876-a222-572c0056ef9c req-a6dddf58-c158-4646-8ff1-d9b861982d28 tempest-DeleteServersTestJSON-1707743062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-70de95fb-aec9-4876-a222-572c0056ef9c req-a6dddf58-c158-4646-8ff1-d9b861982d28 tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-70de95fb-aec9-4876-a222-572c0056ef9c req-a6dddf58-c158-4646-8ff1-d9b861982d28 tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-70de95fb-aec9-4876-a222-572c0056ef9c req-a6dddf58-c158-4646-8ff1-d9b861982d28 tempest-DeleteServersTestJSON-1707743062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cfe14ed-427a-48f2-aefa-46973219d712', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:40:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-70de95fb-aec9-4876-a222-572c0056ef9c req-a6dddf58-c158-4646-8ff1-d9b861982d28 tempest-DeleteServersTestJSON-1707743062 None] attachment_update completed successfully. Sep 02 00:40:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-ddf0e77e-25cd-4113-ad47-fbeb41a31c95 req-7ace122f-1674-4473-b9b9-d6a7f6161d23 tempest-DeleteServersTestJSON-1707743062 None] Terminate volume connection completed successfully. Sep 02 00:40:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-ddf0e77e-25cd-4113-ad47-fbeb41a31c95 req-7ace122f-1674-4473-b9b9-d6a7f6161d23 tempest-DeleteServersTestJSON-1707743062 None] Deleting attachment 4cfe14ed-427a-48f2-aefa-46973219d712. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:40:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Acquiring lock "cinder-2fd5b2f7-8c1f-4ca7-b934-deed58c12176-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:40:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Lock "cinder-2fd5b2f7-8c1f-4ca7-b934-deed58c12176-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:40:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Acquiring lock "cinder-quobyte-2fd5b2f7-8c1f-4ca7-b934-deed58c12176" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:40:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Lock "cinder-quobyte-2fd5b2f7-8c1f-4ca7-b934-deed58c12176" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:40:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3def9-02d3-46c8-8478-7881b0bda69b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:40:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:54 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 Sep 02 00:40:54 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:54 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176" returned: 0 in 0.498s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:54 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176 Sep 02 00:40:54 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:54 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2fd5b2f7-8c1f-4ca7-b934-deed58c12176" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Lock "cinder-quobyte-2fd5b2f7-8c1f-4ca7-b934-deed58c12176" released by "delete_volume" :: held 0.851s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Created reservations ['7395c612-d787-4b6a-903e-a447959cbf9c', 'd4017ff3-ef0a-4028-b085-025939e34fa8', '43ce0aac-d4fe-46f2-855c-9b20aca87228', '4202156f-bf5f-4c09-a679-660a02303fc2'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:40:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:40:54 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:40:54 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:40:55 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Sep 02 00:40:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:40:55 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:40:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Deleted volume successfully. Sep 02 00:40:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22829b1b-983a-4b6a-b55f-007735df994c tempest-DeleteServersTestJSON-1707743062 None] Lock "cinder-2fd5b2f7-8c1f-4ca7-b934-deed58c12176-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:04 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=14 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:41:05 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=11,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Flow 'volume_create_manager' (5f14c8f0-1c29-4482-9489-162ee39e5f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97ae75e-9509-439b-bb89-030ab28e8433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97ae75e-9509-439b-bb89-030ab28e8433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2081082569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='357a3e17c8e04e94b1344647a6b85c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:07Z,use_quota=True,user_id='4db764068b11452196571cba036e76fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786c4a8b-4e26-4708-ae4f-626dc6626de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786c4a8b-4e26-4708-ae4f-626dc6626de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172600d-4d2c-4604-a6ed-3d5cccce72a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172600d-4d2c-4604-a6ed-3d5cccce72a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aefc6c-5cfd-4681-8c2a-3e14ebf992eb', 'volume_name': 'volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53ad08e-50ba-4cdf-8657-324a73fd4547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53ad08e-50ba-4cdf-8657-324a73fd4547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac9cdc5-5101-47e9-9610-b6a60ca8afd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:07 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Volume d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb', 'volume_size': 1} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2081082569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='357a3e17c8e04e94b1344647a6b85c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:07Z,use_quota=True,user_id='4db764068b11452196571cba036e76fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Creating volume d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:41:07 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:41:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:07 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb 1073741824 Sep 02 00:41:07 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:08 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb 1073741824" returned: 0 in 0.697s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:08 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb Sep 02 00:41:08 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:08 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac9cdc5-5101-47e9-9610-b6a60ca8afd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8f9904-0545-49d8-9664-b8ee044975a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Volume volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb (d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb): created successfully Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8f9904-0545-49d8-9664-b8ee044975a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Flow 'volume_create_manager' (5f14c8f0-1c29-4482-9489-162ee39e5f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a347635a-84dc-4f84-8ecf-88eb448db086 tempest-VolumesTestJSON-986546623 None] Created volume successfully. Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Flow 'volume_create_manager' (babc9f75-5b5e-4ec0-8694-ed056eaa40b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a42ed8-f597-4360-9c79-13f21314baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a42ed8-f597-4360-9c79-13f21314baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1784862538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='357a3e17c8e04e94b1344647a6b85c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:11Z,use_quota=True,user_id='4db764068b11452196571cba036e76fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29693f2-fbd6-4365-8fda-a38381bc1135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29693f2-fbd6-4365-8fda-a38381bc1135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fb3e8c-41cb-4b98-97d4-1cfd82d53753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fb3e8c-41cb-4b98-97d4-1cfd82d53753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0', 'volume_name': 'volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7232aa6f-324c-426f-b3c5-23838976aaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7232aa6f-324c-426f-b3c5-23838976aaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f6e4b-a7cf-486e-a32a-f8cb33fce618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Volume 1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0', 'volume_size': 1} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1784862538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='357a3e17c8e04e94b1344647a6b85c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:11Z,use_quota=True,user_id='4db764068b11452196571cba036e76fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Creating volume 1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:41:10 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:41:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:10 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 1073741824 Sep 02 00:41:10 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:11 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 1073741824" returned: 0 in 0.545s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:11 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 Sep 02 00:41:11 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:11 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f6e4b-a7cf-486e-a32a-f8cb33fce618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08ad958-0d4b-4cf6-8ee8-2c06ef5ad60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Volume volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 (1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0): created successfully Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08ad958-0d4b-4cf6-8ee8-2c06ef5ad60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Flow 'volume_create_manager' (babc9f75-5b5e-4ec0-8694-ed056eaa40b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c74c4e75-37c4-4536-8e8b-abfb7bfd2700 tempest-VolumesTestJSON-986546623 None] Created volume successfully. Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:12 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:12 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:12 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.433s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 8 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:41:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Flow 'volume_create_manager' (e7e1f618-dd58-4860-824d-634ea0c9bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f5d4eb-ebb0-4d5e-8871-e27f8cb1512c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f5d4eb-ebb0-4d5e-8871-e27f8cb1512c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-464580790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1afabab-2820-4ef7-a6b0-2f92c952f406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='357a3e17c8e04e94b1344647a6b85c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:14Z,use_quota=True,user_id='4db764068b11452196571cba036e76fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee68e2f7-c00f-4965-b349-67a95d2236fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee68e2f7-c00f-4965-b349-67a95d2236fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013c44f4-f284-45c4-8e30-7cfbeafba4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013c44f4-f284-45c4-8e30-7cfbeafba4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1afabab-2820-4ef7-a6b0-2f92c952f406', 'volume_name': 'volume-c1afabab-2820-4ef7-a6b0-2f92c952f406', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76425ad7-dc6a-469d-b02a-b355f55a5498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76425ad7-dc6a-469d-b02a-b355f55a5498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf62bc3-b142-46b8-9a34-a520c8f3157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Volume c1afabab-2820-4ef7-a6b0-2f92c952f406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1afabab-2820-4ef7-a6b0-2f92c952f406', 'volume_size': 1} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-464580790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1afabab-2820-4ef7-a6b0-2f92c952f406,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='357a3e17c8e04e94b1344647a6b85c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:14Z,use_quota=True,user_id='4db764068b11452196571cba036e76fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Creating volume c1afabab-2820-4ef7-a6b0-2f92c952f406 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:41:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:14 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 1073741824 Sep 02 00:41:14 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:14 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 1073741824" returned: 0 in 0.771s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:15 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 Sep 02 00:41:15 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:15 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406" returned: 0 in 0.692s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf62bc3-b142-46b8-9a34-a520c8f3157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1afabab-2820-4ef7-a6b0-2f92c952f406', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb3201f-9e12-4ac8-a60e-dc94e25a7069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Volume volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 (c1afabab-2820-4ef7-a6b0-2f92c952f406): created successfully Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb3201f-9e12-4ac8-a60e-dc94e25a7069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Flow 'volume_create_manager' (e7e1f618-dd58-4860-824d-634ea0c9bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c2247c0e-ec30-4b1e-9209-f702b7cdd424 tempest-VolumesTestJSON-986546623 None] Created volume successfully. Sep 02 00:41:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Acquiring lock "cinder-c1afabab-2820-4ef7-a6b0-2f92c952f406-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Lock "cinder-c1afabab-2820-4ef7-a6b0-2f92c952f406-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Acquiring lock "cinder-quobyte-c1afabab-2820-4ef7-a6b0-2f92c952f406" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Lock "cinder-quobyte-c1afabab-2820-4ef7-a6b0-2f92c952f406" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[099eddd0-716b-46f1-a86b-676aaafe3f23]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:41:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:19 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 Sep 02 00:41:19 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-89e8f1e7-ad54-47d1-a636-076aa13794bd req-9bf82fdd-7c62-4b49-b6da-3a2052f537ed tempest-AttachVolumeTestJSON-2070218218 None] Terminate volume connection completed successfully. Sep 02 00:41:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-89e8f1e7-ad54-47d1-a636-076aa13794bd req-9bf82fdd-7c62-4b49-b6da-3a2052f537ed tempest-AttachVolumeTestJSON-2070218218 None] Deleting attachment 883f0287-e144-4126-bc58-691c12822154. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:41:19 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:19 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406 Sep 02 00:41:19 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:19 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1afabab-2820-4ef7-a6b0-2f92c952f406" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Lock "cinder-quobyte-c1afabab-2820-4ef7-a6b0-2f92c952f406" released by "delete_volume" :: held 0.972s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:19 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Created reservations ['6edd9396-a6fe-4a7d-9f12-434b67ddd9ca', 'e4408152-513e-4fcf-89fc-2a9b53eb91da', '7145097b-feec-4654-8850-fccf636cd843', 'c781ceb8-b548-496b-bfe3-629f8642a837'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:20 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:20 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:20 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Deleted volume successfully. Sep 02 00:41:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1205b998-cfbf-48ef-b429-3cc7f505c9ea tempest-VolumesTestJSON-986546623 None] Lock "cinder-c1afabab-2820-4ef7-a6b0-2f92c952f406-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Acquiring lock "cinder-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Lock "cinder-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Acquiring lock "cinder-quobyte-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Lock "cinder-quobyte-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4ebe2f-a47e-4713-a7cb-d023f961d67c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:21 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 Sep 02 00:41:21 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:21 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0" returned: 0 in 0.460s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:21 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0 Sep 02 00:41:21 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:22 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0" returned: 0 in 0.329s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Lock "cinder-quobyte-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0" released by "delete_volume" :: held 0.849s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Created reservations ['4da98020-3b62-4c93-bfee-0ecc02cb8ada', '3a889776-261b-4944-8dbb-6e8e6e2574bf', '371b65e5-5e9d-4c46-9142-cb747e9ca693', '3a4ea800-94b5-458e-9de4-60cda64b7581'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:22 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:22 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Acquiring lock "cinder-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Lock "cinder-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Acquiring lock "cinder-quobyte-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Lock "cinder-quobyte-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794127d-d1ad-46fc-8a9f-748413bf53c7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:22 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.561s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Deleted volume successfully. Sep 02 00:41:22 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb Sep 02 00:41:22 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1048bdb5-266a-4494-a00f-0ba9d6f96d7b tempest-VolumesTestJSON-986546623 None] Lock "cinder-1e67b9c5-7c62-4e42-9f47-b2f1319fb2f0-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:23 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb" returned: 0 in 0.757s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:23 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb Sep 02 00:41:23 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Flow 'volume_create_manager' (9bbdea9c-fe17-4062-9256-692a036a8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15927b7b-12e7-4ba4-a519-63dd93089117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15927b7b-12e7-4ba4-a519-63dd93089117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795471428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1324ebdd-5300-4fbb-8a4c-fe675f4280c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cca8e2393cc48e1acda33569ecc504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:23Z,use_quota=True,user_id='c701ce1c3d7b4b61bb792091e8a7cb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23ab802-f80b-4d77-b5cc-3293ac933652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23ab802-f80b-4d77-b5cc-3293ac933652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d848c31-c85c-4680-a94a-4fcd51822529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d848c31-c85c-4680-a94a-4fcd51822529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1324ebdd-5300-4fbb-8a4c-fe675f4280c4', 'volume_name': 'volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc362cd-3099-44b2-8077-cef623ea146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc362cd-3099-44b2-8077-cef623ea146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282425c6-0125-442d-a230-d38af0388aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Volume 1324ebdd-5300-4fbb-8a4c-fe675f4280c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4', 'volume_size': 1} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795471428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1324ebdd-5300-4fbb-8a4c-fe675f4280c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cca8e2393cc48e1acda33569ecc504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:23Z,use_quota=True,user_id='c701ce1c3d7b4b61bb792091e8a7cb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Creating volume 1324ebdd-5300-4fbb-8a4c-fe675f4280c4 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:41:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:23 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 1073741824 Sep 02 00:41:23 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:23 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Lock "cinder-quobyte-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb" released by "delete_volume" :: held 1.249s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Created reservations ['038b2bd5-d461-4e25-9a33-373a2ce16cff', '27441780-906f-4df9-9180-5b2872044a4c', '4a27b9ce-c0ed-49a2-bb00-f8c7726bc43e', 'd4609e67-73b5-40a8-b673-b7276a3b08b5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:24 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:24 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:24 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 1073741824" returned: 0 in 0.724s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:24 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:24 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.360s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:24 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Deleted volume successfully. Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd21782c-1fdf-431e-b560-19977cbfca2c tempest-VolumesTestJSON-986546623 None] Lock "cinder-d0aefc6c-5cfd-4681-8c2a-3e14ebf992eb-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:24 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282425c6-0125-442d-a230-d38af0388aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254c35e5-7bcf-4493-8102-7401db00a297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Volume volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 (1324ebdd-5300-4fbb-8a4c-fe675f4280c4): created successfully Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254c35e5-7bcf-4493-8102-7401db00a297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Flow 'volume_create_manager' (9bbdea9c-fe17-4062-9256-692a036a8785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8bf79503-4514-4e14-b1dd-0fd7ca4ba5c7 tempest-ServersNegativeTestJSON-1816821298 None] Created volume successfully. Sep 02 00:41:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:41:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Flow 'volume_create_manager' (7d8bde14-f89f-491c-91c4-35ad97f0f88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9464c22-f137-4d2f-90ff-000f85835167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9464c22-f137-4d2f-90ff-000f85835167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-147739965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537f4e2c-d68b-4f2e-83ad-5144600318d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cca8e2393cc48e1acda33569ecc504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:30Z,use_quota=True,user_id='c701ce1c3d7b4b61bb792091e8a7cb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd751388-9e0d-4b17-8575-4e5744552c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd751388-9e0d-4b17-8575-4e5744552c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64da79ad-985d-4868-8b9e-3c853f5922d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64da79ad-985d-4868-8b9e-3c853f5922d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537f4e2c-d68b-4f2e-83ad-5144600318d9', 'volume_name': 'volume-537f4e2c-d68b-4f2e-83ad-5144600318d9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d562590-519f-4e28-9f05-90f665b4c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d562590-519f-4e28-9f05-90f665b4c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd73b119-3fa1-4d23-8f0e-7516a66e499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Volume 537f4e2c-d68b-4f2e-83ad-5144600318d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537f4e2c-d68b-4f2e-83ad-5144600318d9', 'volume_size': 1} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-147739965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537f4e2c-d68b-4f2e-83ad-5144600318d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cca8e2393cc48e1acda33569ecc504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:30Z,use_quota=True,user_id='c701ce1c3d7b4b61bb792091e8a7cb8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Creating volume 537f4e2c-d68b-4f2e-83ad-5144600318d9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:41:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:30 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 1073741824 Sep 02 00:41:30 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Flow 'volume_create_manager' (b2c518b7-d24d-4ca1-ba3d-24052b29128d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29acbf14-bc47-41d0-9f5a-10c2a52eda18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29acbf14-bc47-41d0-9f5a-10c2a52eda18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1249862732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f95ac74-8937-46fa-8573-0b33093e10bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb3c59858a46ddb4139bfd18aef22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:31Z,use_quota=True,user_id='33ad0255049941538bc8bc4a7b9f8ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26afd34f-8449-42dd-a019-072ef3b77a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26afd34f-8449-42dd-a019-072ef3b77a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301e865e-ac37-4dc9-80ec-348af80d5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301e865e-ac37-4dc9-80ec-348af80d5673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f95ac74-8937-46fa-8573-0b33093e10bc', 'volume_name': 'volume-2f95ac74-8937-46fa-8573-0b33093e10bc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9369423b-9e3b-449e-ac2e-708ce2a34b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9369423b-9e3b-449e-ac2e-708ce2a34b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28dd634-7e48-4a2f-8b12-8f5e74877389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Volume 2f95ac74-8937-46fa-8573-0b33093e10bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f95ac74-8937-46fa-8573-0b33093e10bc', 'volume_size': 1} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:30 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 1073741824" returned: 0 in 0.752s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:30 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 Sep 02 00:41:30 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:31 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1249862732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f95ac74-8937-46fa-8573-0b33093e10bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bb3c59858a46ddb4139bfd18aef22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:31Z,use_quota=True,user_id='33ad0255049941538bc8bc4a7b9f8ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Creating volume 2f95ac74-8937-46fa-8573-0b33093e10bc {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:41:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd73b119-3fa1-4d23-8f0e-7516a66e499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537f4e2c-d68b-4f2e-83ad-5144600318d9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:31 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc 1073741824 Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dac9a1-38fa-44da-a65c-65aad735791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:31 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Volume volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 (537f4e2c-d68b-4f2e-83ad-5144600318d9): created successfully Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dac9a1-38fa-44da-a65c-65aad735791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Flow 'volume_create_manager' (7d8bde14-f89f-491c-91c4-35ad97f0f88d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-05a05c01-f02f-4b97-b2e8-ea36d0de7c0d tempest-ServersNegativeTestJSON-1816821298 None] Created volume successfully. Sep 02 00:41:31 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc 1073741824" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:31 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc Sep 02 00:41:31 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:31 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc" returned: 0 in 0.268s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28dd634-7e48-4a2f-8b12-8f5e74877389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f95ac74-8937-46fa-8573-0b33093e10bc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2002f2d2-74d1-45a5-aeb5-df29f378e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Volume volume-2f95ac74-8937-46fa-8573-0b33093e10bc (2f95ac74-8937-46fa-8573-0b33093e10bc): created successfully Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2002f2d2-74d1-45a5-aeb5-df29f378e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Flow 'volume_create_manager' (b2c518b7-d24d-4ca1-ba3d-24052b29128d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0197d2ff-c364-4629-920a-a6295ac6ba99 tempest-TaggedAttachmentsTest-1994752416 None] Created volume successfully. Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "cinder-537f4e2c-d68b-4f2e-83ad-5144600318d9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-537f4e2c-d68b-4f2e-83ad-5144600318d9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "cinder-quobyte-537f4e2c-d68b-4f2e-83ad-5144600318d9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-quobyte-537f4e2c-d68b-4f2e-83ad-5144600318d9" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66562ea-f706-498e-96d6-c989b6858206]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:41:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:32 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 Sep 02 00:41:32 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:33 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9" returned: 0 in 0.525s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:33 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9 Sep 02 00:41:33 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:33 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-537f4e2c-d68b-4f2e-83ad-5144600318d9" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-quobyte-537f4e2c-d68b-4f2e-83ad-5144600318d9" released by "delete_volume" :: held 0.923s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Created reservations ['3882d122-0b62-4b51-aebf-1d33a44ab851', '826d9279-903c-4046-8b8c-e6041fbc0ce7', 'ad498b0c-d29a-4783-8035-03b08b4bcf3d', 'fae43c48-7ae5-416b-87db-a8c8e1d05cab'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:33 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:33 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "cinder-1324ebdd-5300-4fbb-8a4c-fe675f4280c4-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-1324ebdd-5300-4fbb-8a4c-fe675f4280c4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "cinder-quobyte-1324ebdd-5300-4fbb-8a4c-fe675f4280c4" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-quobyte-1324ebdd-5300-4fbb-8a4c-fe675f4280c4" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d0bd32-e4f1-4cd4-9a3b-60c580717390]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:34 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 Sep 02 00:41:34 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:34 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.702s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Deleted volume successfully. Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-45676875-ba5b-4cba-9587-f55fd8d4afde tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-537f4e2c-d68b-4f2e-83ad-5144600318d9-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:34 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:34 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4 Sep 02 00:41:34 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:34 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1324ebdd-5300-4fbb-8a4c-fe675f4280c4" returned: 0 in 0.353s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-quobyte-1324ebdd-5300-4fbb-8a4c-fe675f4280c4" released by "delete_volume" :: held 0.967s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Created reservations ['c0c42901-071e-46d7-a6ac-409f686baff1', '6ba02f82-def6-41c9-9acc-ab334980ab26', '0a5f338f-a684-428f-b72d-bf5eff24a47c', '4ca59883-3dcb-4d35-a2f2-32530a8e9383'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:35 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:35 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:35 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Deleted volume successfully. Sep 02 00:41:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-841c9c49-600e-479b-94c0-108f8ffd226e tempest-ServersNegativeTestJSON-1816821298 None] Lock "cinder-1324ebdd-5300-4fbb-8a4c-fe675f4280c4-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:45 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=42,cinder:UPDATE=54,cinder:DELETE=8,cinder:INSERT=14 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:41:45 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=62,cinder:SELECT=34,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:41:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-72e7efec-1d75-478b-8bc3-10918884cbc5 tempest-GroupsTest-111983734 None] Group tempest-Group1-716949676: creating Sep 02 00:41:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-72e7efec-1d75-478b-8bc3-10918884cbc5 tempest-GroupsTest-111983734 None] Group tempest-Group1-716949676: created successfully Sep 02 00:41:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-72e7efec-1d75-478b-8bc3-10918884cbc5 tempest-GroupsTest-111983734 None] Create group completed successfully. Sep 02 00:41:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-10baf774-923f-4edc-b82b-befe3934d910 tempest-GroupsTest-111983734 None] Group tempest-Group2-1227235034: creating Sep 02 00:41:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-10baf774-923f-4edc-b82b-befe3934d910 tempest-GroupsTest-111983734 None] Group tempest-Group2-1227235034: created successfully Sep 02 00:41:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-10baf774-923f-4edc-b82b-befe3934d910 tempest-GroupsTest-111983734 None] Create group completed successfully. Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Flow 'volume_create_manager' (df0b32a7-14d0-4bd0-afae-85ad584e9153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c471471-7ab3-40d8-a9f6-2ba76a2454d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c471471-7ab3-40d8-a9f6-2ba76a2454d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009587816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2f296a7-012a-4400-a054-ddc3eebe6d00,host='devstack@QuobyteHD#QuobyteHD',id=7a4d302d-d0aa-408e-841f-335285d7f412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a7008691e04643aa16e98699efc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:50Z,use_quota=True,user_id='edba713186f84878b1b0a81e5884031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0166e9b6-2ece-4e3a-9c37-027e2a165837),volume_type_id=0166e9b6-2ece-4e3a-9c37-027e2a165837)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34849691-ea7e-472b-bb60-457bd5916f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34849691-ea7e-472b-bb60-457bd5916f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e40629-7b8f-482b-a170-4b83405baff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e40629-7b8f-482b-a170-4b83405baff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4d302d-d0aa-408e-841f-335285d7f412', 'volume_name': 'volume-7a4d302d-d0aa-408e-841f-335285d7f412', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3389ad4-ddd5-4dff-806c-ec3a8fe78e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3389ad4-ddd5-4dff-806c-ec3a8fe78e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db6d2ad-a1a5-4c35-9e88-5c057cf2ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Volume 7a4d302d-d0aa-408e-841f-335285d7f412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4d302d-d0aa-408e-841f-335285d7f412', 'volume_size': 1} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2f296a7-012a-4400-a054-ddc3eebe6d00,created_at=2026-09-01T22:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009587816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2f296a7-012a-4400-a054-ddc3eebe6d00,host='devstack@QuobyteHD#QuobyteHD',id=7a4d302d-d0aa-408e-841f-335285d7f412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a7008691e04643aa16e98699efc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:41:50Z,use_quota=True,user_id='edba713186f84878b1b0a81e5884031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0166e9b6-2ece-4e3a-9c37-027e2a165837),volume_type_id=0166e9b6-2ece-4e3a-9c37-027e2a165837)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Creating volume 7a4d302d-d0aa-408e-841f-335285d7f412 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:41:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:41:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:50 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 1073741824 Sep 02 00:41:50 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:51 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 1073741824" returned: 0 in 0.650s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:51 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 Sep 02 00:41:51 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:51 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412" returned: 0 in 0.263s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db6d2ad-a1a5-4c35-9e88-5c057cf2ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4d302d-d0aa-408e-841f-335285d7f412', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3ebb06-c67f-4ec1-bf82-35cf030c01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:41:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Volume volume-7a4d302d-d0aa-408e-841f-335285d7f412 (7a4d302d-d0aa-408e-841f-335285d7f412): created successfully Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3ebb06-c67f-4ec1-bf82-35cf030c01b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:41:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Flow 'volume_create_manager' (df0b32a7-14d0-4bd0-afae-85ad584e9153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:41:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-63284638-7539-4167-863c-6237511928c0 tempest-GroupsTest-111983734 None] Created volume successfully. Sep 02 00:41:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Acquiring lock "cinder-quobyte-7a4d302d-d0aa-408e-841f-335285d7f412" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:41:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Lock "cinder-quobyte-7a4d302d-d0aa-408e-841f-335285d7f412" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:41:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b33672-efe3-470b-86d2-43fb012c94e9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:41:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:54 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 Sep 02 00:41:54 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:54 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412" returned: 0 in 0.770s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:54 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412 Sep 02 00:41:54 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:55 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7a4d302d-d0aa-408e-841f-335285d7f412" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Lock "cinder-quobyte-7a4d302d-d0aa-408e-841f-335285d7f412" released by "delete_volume" :: held 1.261s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Created reservations ['f8a22308-223b-45ae-a7a0-e12f6b7f234f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:55 devstack cinder-volume[87232]: WARNING cinder.quota [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-13561513 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-13561513, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:41:55 devstack cinder-volume[87232]: WARNING cinder.quota [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-13561513 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-13561513, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Created reservations ['91198001-3f1b-47ea-8d47-bbd5ce6dbcbb', '284dad44-6cf8-42cb-8bd2-16a6ad507447', '7e775740-322d-4817-adf7-4d3aa56879e2', 'f471c576-f489-456a-8a94-9058ffe92201'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:55 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:55 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:56 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e22323ca-2fcc-478f-9a6b-956a0a60a112 tempest-GroupsTest-111983734 None] Delete group completed successfully. Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Created reservations ['8af48482-5a85-47fc-bc93-12bdf3603f2f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:41:57 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:41:57 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:41:57 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.494s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:41:57 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:41:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-07953d36-e248-486d-85bf-818c7e872952 tempest-GroupsTest-111983734 None] Delete group completed successfully. Sep 02 00:41:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cf9ef116-24ce-4135-8f71-e56cb8310fba tempest-GroupsTest-111983734 None] Group tempest-GroupsTest-Group-182045452: creating Sep 02 00:41:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cf9ef116-24ce-4135-8f71-e56cb8310fba tempest-GroupsTest-111983734 None] Group tempest-GroupsTest-Group-182045452: created successfully Sep 02 00:41:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cf9ef116-24ce-4135-8f71-e56cb8310fba tempest-GroupsTest-111983734 None] Create group completed successfully. Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Flow 'volume_create_manager' (4e372167-a32d-4aab-bd04-5921b7f2f93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2fd192-76f4-4c42-87af-a87547c776fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2fd192-76f4-4c42-87af-a87547c776fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-726252400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d111f00-63c5-4c4f-bb04-a3a3876f96d0,host='devstack@QuobyteHD#QuobyteHD',id=1c0b900a-da22-4d75-9790-2eb31507db14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a7008691e04643aa16e98699efc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:01Z,use_quota=True,user_id='edba713186f84878b1b0a81e5884031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13f78f98-c5e7-40cb-8670-83507a0cf897),volume_type_id=13f78f98-c5e7-40cb-8670-83507a0cf897)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6092e418-54de-4be9-88e2-310c2105eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6092e418-54de-4be9-88e2-310c2105eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155ad94d-97b4-411f-8f72-6c003c79fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155ad94d-97b4-411f-8f72-6c003c79fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0b900a-da22-4d75-9790-2eb31507db14', 'volume_name': 'volume-1c0b900a-da22-4d75-9790-2eb31507db14', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de73588-0d46-409d-a083-3d9b263955ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de73588-0d46-409d-a083-3d9b263955ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865b54c3-343b-47e1-bf97-9efeda710557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Volume 1c0b900a-da22-4d75-9790-2eb31507db14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0b900a-da22-4d75-9790-2eb31507db14', 'volume_size': 1} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9d111f00-63c5-4c4f-bb04-a3a3876f96d0,created_at=2026-09-01T22:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-726252400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d111f00-63c5-4c4f-bb04-a3a3876f96d0,host='devstack@QuobyteHD#QuobyteHD',id=1c0b900a-da22-4d75-9790-2eb31507db14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a7008691e04643aa16e98699efc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:01Z,use_quota=True,user_id='edba713186f84878b1b0a81e5884031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13f78f98-c5e7-40cb-8670-83507a0cf897),volume_type_id=13f78f98-c5e7-40cb-8670-83507a0cf897)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Creating volume 1c0b900a-da22-4d75-9790-2eb31507db14 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:42:01 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:01 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 1073741824 Sep 02 00:42:01 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:01 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 1073741824" returned: 0 in 0.540s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:01 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 Sep 02 00:42:01 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:01 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865b54c3-343b-47e1-bf97-9efeda710557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0b900a-da22-4d75-9790-2eb31507db14', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eced133c-ef5e-4895-b0bf-87f979344b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Volume volume-1c0b900a-da22-4d75-9790-2eb31507db14 (1c0b900a-da22-4d75-9790-2eb31507db14): created successfully Sep 02 00:42:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eced133c-ef5e-4895-b0bf-87f979344b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Flow 'volume_create_manager' (4e372167-a32d-4aab-bd04-5921b7f2f93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8e9686cc-88cf-46ad-bb19-26688a3b4d62 tempest-GroupsTest-111983734 None] Created volume successfully. Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Flow 'volume_create_manager' (4f5f5254-8322-4d1c-8150-984e143d850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99b672c-4e2b-4eb5-93f8-bc98c47804e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99b672c-4e2b-4eb5-93f8-bc98c47804e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1973916969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d111f00-63c5-4c4f-bb04-a3a3876f96d0,host='devstack@QuobyteHD#QuobyteHD',id=6204314b-ce38-4dd2-bac3-15fefabe1200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a7008691e04643aa16e98699efc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:04Z,use_quota=True,user_id='edba713186f84878b1b0a81e5884031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13f78f98-c5e7-40cb-8670-83507a0cf897),volume_type_id=13f78f98-c5e7-40cb-8670-83507a0cf897)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecc527d-5598-4e8b-b95d-e70a630a8bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecc527d-5598-4e8b-b95d-e70a630a8bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da98d58a-74c9-4d83-bd5c-b12668bae7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da98d58a-74c9-4d83-bd5c-b12668bae7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6204314b-ce38-4dd2-bac3-15fefabe1200', 'volume_name': 'volume-6204314b-ce38-4dd2-bac3-15fefabe1200', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d9f1b7-21ea-48bd-8a3c-1b39e1e96bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d9f1b7-21ea-48bd-8a3c-1b39e1e96bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2ef27-07b6-4796-b42f-a26f3e4eb7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Volume 6204314b-ce38-4dd2-bac3-15fefabe1200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6204314b-ce38-4dd2-bac3-15fefabe1200', 'volume_size': 1} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9d111f00-63c5-4c4f-bb04-a3a3876f96d0,created_at=2026-09-01T22:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1973916969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d111f00-63c5-4c4f-bb04-a3a3876f96d0,host='devstack@QuobyteHD#QuobyteHD',id=6204314b-ce38-4dd2-bac3-15fefabe1200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a7008691e04643aa16e98699efc572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:04Z,use_quota=True,user_id='edba713186f84878b1b0a81e5884031d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13f78f98-c5e7-40cb-8670-83507a0cf897),volume_type_id=13f78f98-c5e7-40cb-8670-83507a0cf897)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Creating volume 6204314b-ce38-4dd2-bac3-15fefabe1200 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:42:04 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:42:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:04 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 1073741824 Sep 02 00:42:04 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:05 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 1073741824" returned: 0 in 0.842s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:05 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 Sep 02 00:42:05 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:05 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2ef27-07b6-4796-b42f-a26f3e4eb7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6204314b-ce38-4dd2-bac3-15fefabe1200', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1b0a5b-32ff-470a-b3a2-258f0f987204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Volume volume-6204314b-ce38-4dd2-bac3-15fefabe1200 (6204314b-ce38-4dd2-bac3-15fefabe1200): created successfully Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1b0a5b-32ff-470a-b3a2-258f0f987204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Flow 'volume_create_manager' (4f5f5254-8322-4d1c-8150-984e143d850d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8415957c-48ce-4c86-9445-cd8913feeb06 tempest-GroupsTest-111983734 None] Created volume successfully. Sep 02 00:42:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d624cd1e-608d-43c1-9a12-906e90fa5f43 tempest-GroupsTest-111983734 None] Update group completed successfully. Sep 02 00:42:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fa3a6d6e-3a39-4f0a-b318-5ee12f74b5df tempest-GroupsTest-111983734 None] Update group completed successfully. Sep 02 00:42:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Acquiring lock "cinder-quobyte-1c0b900a-da22-4d75-9790-2eb31507db14" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Lock "cinder-quobyte-1c0b900a-da22-4d75-9790-2eb31507db14" acquired by "delete_volume" :: waited 0.057s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d990ef-726b-48f0-a295-2b74025637cb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:42:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:11 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 Sep 02 00:42:11 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:11 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14" returned: 0 in 0.694s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:11 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14 Sep 02 00:42:11 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:12 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:42:12 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:12 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1c0b900a-da22-4d75-9790-2eb31507db14" returned: 0 in 0.653s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Lock "cinder-quobyte-1c0b900a-da22-4d75-9790-2eb31507db14" released by "delete_volume" :: held 1.442s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Acquiring lock "cinder-quobyte-6204314b-ce38-4dd2-bac3-15fefabe1200" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Lock "cinder-quobyte-6204314b-ce38-4dd2-bac3-15fefabe1200" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b407cf-3982-4270-94be-b198342242f1]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:12 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 Sep 02 00:42:12 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:12 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:42:12 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200" returned: 0 in 0.584s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:13 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200 Sep 02 00:42:13 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:13 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6204314b-ce38-4dd2-bac3-15fefabe1200" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Lock "cinder-quobyte-6204314b-ce38-4dd2-bac3-15fefabe1200" released by "delete_volume" :: held 0.972s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Created reservations ['e0218670-1060-4c40-9868-8150ccaa42c5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:13 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-550320510 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-550320510, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:42:13 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-550320510 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-550320510, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Created reservations ['1e675f06-d436-4d7b-a03d-859c794cc271', '80b326c0-e83e-4c31-827a-81e23136b6c4', '0625ebe7-2e77-45b5-8a2f-18644705d8b1', 'c812f082-37a4-415e-8b9d-1334db41b497'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Created reservations ['e74c4eb0-b9c1-4275-a71a-fc98f4e2cdd3', '0dcd1147-d0f5-4088-aa9a-192685606302', '0b696771-3677-44c3-b904-c4924cc42da3', '66670e67-f583-4c7c-a829-8f58650e0997'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:14 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:42:14 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:14 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.465s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:14 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:42:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4c143e65-67b8-43bc-a9d8-0225f89a9cf5 tempest-GroupsTest-111983734 None] Delete group completed successfully. Sep 02 00:42:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d8d733b6-c623-4dd6-9cda-f999b607943e req-de0f87d8-7710-47d2-b9fb-6912c71b3361 tempest-TaggedAttachmentsTest-1994752416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d8d733b6-c623-4dd6-9cda-f999b607943e req-de0f87d8-7710-47d2-b9fb-6912c71b3361 tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d8d733b6-c623-4dd6-9cda-f999b607943e req-de0f87d8-7710-47d2-b9fb-6912c71b3361 tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-d8d733b6-c623-4dd6-9cda-f999b607943e req-de0f87d8-7710-47d2-b9fb-6912c71b3361 tempest-TaggedAttachmentsTest-1994752416 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-2f95ac74-8937-46fa-8573-0b33093e10bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e75bd00-9e3e-4169-ba99-9f7ff6b6b848', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:42:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-d8d733b6-c623-4dd6-9cda-f999b607943e req-de0f87d8-7710-47d2-b9fb-6912c71b3361 tempest-TaggedAttachmentsTest-1994752416 None] attachment_update completed successfully. Sep 02 00:42:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-0893211c-ef0d-42bf-916b-655fb9e5188a req-f2f381b5-9746-424e-8844-8d90cb670f13 tempest-TaggedAttachmentsTest-1994752416 None] Terminate volume connection completed successfully. Sep 02 00:42:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0893211c-ef0d-42bf-916b-655fb9e5188a req-f2f381b5-9746-424e-8844-8d90cb670f13 tempest-TaggedAttachmentsTest-1994752416 None] Deleting attachment 0e75bd00-9e3e-4169-ba99-9f7ff6b6b848. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:42:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-07d37f3c-eaf9-451f-a5da-9668250939bb tempest-GroupsV320Test-198960645 None] Group tempest-GroupsV320Test-Group-1459573832: creating Sep 02 00:42:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-07d37f3c-eaf9-451f-a5da-9668250939bb tempest-GroupsV320Test-198960645 None] Group tempest-GroupsV320Test-Group-1459573832: created successfully Sep 02 00:42:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-07d37f3c-eaf9-451f-a5da-9668250939bb tempest-GroupsV320Test-198960645 None] Create group completed successfully. Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Created reservations ['15b55185-f168-4dc1-a388-6caa12cdc3be'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:27 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:42:27 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:27 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.317s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:27 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:42:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-00f96a31-6d14-4ad7-af7b-355072e00ca5 tempest-GroupsV320Test-198960645 None] Delete group completed successfully. Sep 02 00:42:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:42:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Flow 'volume_create_manager' (37eac22c-1208-43d1-a0f1-646e0f0f4972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b62418-1fd3-4673-b4ca-2423b9329aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b62418-1fd3-4673-b4ca-2423b9329aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221851615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19870f88-a13b-40e7-bb0f-e74cc2951733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647582f9f1b84cbfadde14b791a3f1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:35Z,use_quota=True,user_id='79d3e994db2846b1b8a482454c13ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05c8ec9-08e5-44f1-925a-da598e75920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05c8ec9-08e5-44f1-925a-da598e75920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb3df80-791b-48f2-a463-baf3fd887be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb3df80-791b-48f2-a463-baf3fd887be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19870f88-a13b-40e7-bb0f-e74cc2951733', 'volume_name': 'volume-19870f88-a13b-40e7-bb0f-e74cc2951733', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361cf4fd-944d-4a44-9769-765ed934dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361cf4fd-944d-4a44-9769-765ed934dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d77698e-3bf9-4b7b-97af-405195f83a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Volume 19870f88-a13b-40e7-bb0f-e74cc2951733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19870f88-a13b-40e7-bb0f-e74cc2951733', 'volume_size': 1} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1221851615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19870f88-a13b-40e7-bb0f-e74cc2951733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647582f9f1b84cbfadde14b791a3f1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:35Z,use_quota=True,user_id='79d3e994db2846b1b8a482454c13ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Creating volume 19870f88-a13b-40e7-bb0f-e74cc2951733 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:42:35 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:35 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 1073741824 Sep 02 00:42:35 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:35 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 1073741824" returned: 0 in 0.651s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:35 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 Sep 02 00:42:35 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:36 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733" returned: 0 in 0.363s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d77698e-3bf9-4b7b-97af-405195f83a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19870f88-a13b-40e7-bb0f-e74cc2951733', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d23a4ed-7587-47bd-b27f-77e0e5adde45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Volume volume-19870f88-a13b-40e7-bb0f-e74cc2951733 (19870f88-a13b-40e7-bb0f-e74cc2951733): created successfully Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d23a4ed-7587-47bd-b27f-77e0e5adde45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Flow 'volume_create_manager' (37eac22c-1208-43d1-a0f1-646e0f0f4972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-63b0fcfd-55ac-4d81-96b6-6d2ed3664008 tempest-AttachVolumeTestJSON-2070218218 None] Created volume successfully. Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Acquiring lock "cinder-2f95ac74-8937-46fa-8573-0b33093e10bc-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Lock "cinder-2f95ac74-8937-46fa-8573-0b33093e10bc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Acquiring lock "cinder-quobyte-2f95ac74-8937-46fa-8573-0b33093e10bc" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Lock "cinder-quobyte-2f95ac74-8937-46fa-8573-0b33093e10bc" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c520df1-b601-428c-adc0-81249f6a92ff]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:42:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:36 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc Sep 02 00:42:36 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:37 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:37 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc Sep 02 00:42:37 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:37 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f95ac74-8937-46fa-8573-0b33093e10bc" returned: 0 in 0.285s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Lock "cinder-quobyte-2f95ac74-8937-46fa-8573-0b33093e10bc" released by "delete_volume" :: held 0.751s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Created reservations ['e324dedb-8a25-4fb9-867d-8faf054e01b8', 'b73de5fb-3562-426a-8185-3990e4024abd', 'dfecbc53-1e5a-4eb4-8501-3b25f0baf043', '06dddc14-2cd9-490a-ae0c-4827c2a18216'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:37 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:42:37 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:38 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:38 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:42:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Deleted volume successfully. Sep 02 00:42:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c6aad99d-610a-43ee-aebe-040e964aaa1e tempest-TaggedAttachmentsTest-1994752416 None] Lock "cinder-2f95ac74-8937-46fa-8573-0b33093e10bc-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-055e2049-604e-4a43-9920-d9b759fc17b0 req-b5700ff5-7d04-4c42-a7c6-2032c56e3fcf tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-055e2049-604e-4a43-9920-d9b759fc17b0 req-b5700ff5-7d04-4c42-a7c6-2032c56e3fcf tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-055e2049-604e-4a43-9920-d9b759fc17b0 req-b5700ff5-7d04-4c42-a7c6-2032c56e3fcf tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-055e2049-604e-4a43-9920-d9b759fc17b0 req-b5700ff5-7d04-4c42-a7c6-2032c56e3fcf tempest-AttachVolumeTestJSON-2070218218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-19870f88-a13b-40e7-bb0f-e74cc2951733', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9d7374c-68a1-4f65-87f8-32d313c7b1cc', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:42:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-055e2049-604e-4a43-9920-d9b759fc17b0 req-b5700ff5-7d04-4c42-a7c6-2032c56e3fcf tempest-AttachVolumeTestJSON-2070218218 None] attachment_update completed successfully. Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Flow 'volume_create_manager' (f4b93a60-292e-40ad-9b4f-3a28d8b1a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45ef853-4a4d-4a81-852d-c49954e3ea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45ef853-4a4d-4a81-852d-c49954e3ea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1690203837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b420bcab-58b6-4300-8a63-1dc6a8c79408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647582f9f1b84cbfadde14b791a3f1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:41Z,use_quota=True,user_id='79d3e994db2846b1b8a482454c13ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bafddbd-8641-4aab-ab65-00395b802267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bafddbd-8641-4aab-ab65-00395b802267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2924d6c-4846-4377-9675-1b0bbb6442b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2924d6c-4846-4377-9675-1b0bbb6442b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b420bcab-58b6-4300-8a63-1dc6a8c79408', 'volume_name': 'volume-b420bcab-58b6-4300-8a63-1dc6a8c79408', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c593fdf6-6fdb-4ca6-babb-85d53dd72a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c593fdf6-6fdb-4ca6-babb-85d53dd72a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12558ee6-0045-4e4c-a36b-425485746127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Volume b420bcab-58b6-4300-8a63-1dc6a8c79408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b420bcab-58b6-4300-8a63-1dc6a8c79408', 'volume_size': 1} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1690203837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b420bcab-58b6-4300-8a63-1dc6a8c79408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647582f9f1b84cbfadde14b791a3f1aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:41Z,use_quota=True,user_id='79d3e994db2846b1b8a482454c13ca7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Creating volume b420bcab-58b6-4300-8a63-1dc6a8c79408 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:42:41 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:41 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 1073741824 Sep 02 00:42:41 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:41 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 1073741824" returned: 0 in 0.463s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:41 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 Sep 02 00:42:41 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:42 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:42:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12558ee6-0045-4e4c-a36b-425485746127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b420bcab-58b6-4300-8a63-1dc6a8c79408', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00de6c08-c368-47a7-ba1a-8402ed9d414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Volume volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 (b420bcab-58b6-4300-8a63-1dc6a8c79408): created successfully Sep 02 00:42:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00de6c08-c368-47a7-ba1a-8402ed9d414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Flow 'volume_create_manager' (f4b93a60-292e-40ad-9b4f-3a28d8b1a361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-52958a74-e2ea-4057-8b72-9e1cd55855b5 tempest-AttachVolumeTestJSON-2070218218 None] Created volume successfully. Sep 02 00:42:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-79aa11d8-0f4c-4a1f-8e9d-dbe891d28581 req-df56ed45-4940-4f8d-8db6-11818197bd5e tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-79aa11d8-0f4c-4a1f-8e9d-dbe891d28581 req-df56ed45-4940-4f8d-8db6-11818197bd5e tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-79aa11d8-0f4c-4a1f-8e9d-dbe891d28581 req-df56ed45-4940-4f8d-8db6-11818197bd5e tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-79aa11d8-0f4c-4a1f-8e9d-dbe891d28581 req-df56ed45-4940-4f8d-8db6-11818197bd5e tempest-AttachVolumeTestJSON-2070218218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-b420bcab-58b6-4300-8a63-1dc6a8c79408', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51e1e5d4-940e-4562-b2a4-77706e46356c', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:42:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-79aa11d8-0f4c-4a1f-8e9d-dbe891d28581 req-df56ed45-4940-4f8d-8db6-11818197bd5e tempest-AttachVolumeTestJSON-2070218218 None] attachment_update completed successfully. Sep 02 00:42:46 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=84,cinder:UPDATE=66,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:42:46 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=72,cinder:UPDATE=71,cinder:DELETE=3,cinder:INSERT=9 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Flow 'volume_create_manager' (5bf0b221-a1ef-4cbe-993f-1d7d8c044a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe7e0ef-5eee-4b1a-b3ac-59245e160497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe7e0ef-5eee-4b1a-b3ac-59245e160497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1226003132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e305f3-8d0a-48d1-8d5b-96e4618a0475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0464baba3d6e4da4bbbc6b84bd03bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:47Z,use_quota=True,user_id='801e5fb47ce348e192e36b7179c90fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f3e7f-aa45-4d7d-9a8d-720f618e3c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f3e7f-aa45-4d7d-9a8d-720f618e3c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c035456-be0f-4f86-af9d-c0e01de41994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c035456-be0f-4f86-af9d-c0e01de41994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e305f3-8d0a-48d1-8d5b-96e4618a0475', 'volume_name': 'volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a24132-f065-4f51-b928-5ada75646244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a24132-f065-4f51-b928-5ada75646244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1197b18-e36f-48f0-ba6a-2bb886516ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Volume f8e305f3-8d0a-48d1-8d5b-96e4618a0475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475', 'volume_size': 1} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1226003132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e305f3-8d0a-48d1-8d5b-96e4618a0475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0464baba3d6e4da4bbbc6b84bd03bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:47Z,use_quota=True,user_id='801e5fb47ce348e192e36b7179c90fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Creating volume f8e305f3-8d0a-48d1-8d5b-96e4618a0475 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:42:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:47 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 1073741824 Sep 02 00:42:47 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Flow 'volume_create_manager' (d748e6e7-8ac8-490e-87ed-750936d11866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9792935-cb9b-4ab3-8f86-23f20b2b47ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9792935-cb9b-4ab3-8f86-23f20b2b47ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-474959751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4b9ed5-a3d6-443b-beb4-b070b0759e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bb66758d7840a5947bb39f5112e49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:47Z,use_quota=True,user_id='981c92efb2cc40f2a72b31e94ca51a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8abf92b-bd04-4957-b57f-931390dc69fa),volume_type_id=e8abf92b-bd04-4957-b57f-931390dc69fa)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a558e193-01f0-4c24-8888-6aae6e52ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a558e193-01f0-4c24-8888-6aae6e52ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8332fbba-0b0b-4efa-aca0-422c701fa33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8332fbba-0b0b-4efa-aca0-422c701fa33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca4b9ed5-a3d6-443b-beb4-b070b0759e87', 'volume_name': 'volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdee12e5-99ce-43cc-802c-7c9e82def1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdee12e5-99ce-43cc-802c-7c9e82def1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75058ec0-45ec-43e7-a1a3-d4966312ffde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Volume ca4b9ed5-a3d6-443b-beb4-b070b0759e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87', 'volume_size': 1} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-4a765a6c-e4b0-4ed3-af72-1562108bd685 req-28a33c6e-bd11-4e83-a9c1-2664c5d58fcb tempest-AttachVolumeTestJSON-2070218218 None] Terminate volume connection completed successfully. Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-4a765a6c-e4b0-4ed3-af72-1562108bd685 req-28a33c6e-bd11-4e83-a9c1-2664c5d58fcb tempest-AttachVolumeTestJSON-2070218218 None] Deleting attachment d9d7374c-68a1-4f65-87f8-32d313c7b1cc. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:42:47 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 1073741824" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:47 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 Sep 02 00:42:47 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:48 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-474959751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4b9ed5-a3d6-443b-beb4-b070b0759e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bb66758d7840a5947bb39f5112e49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:42:47Z,use_quota=True,user_id='981c92efb2cc40f2a72b31e94ca51a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8abf92b-bd04-4957-b57f-931390dc69fa),volume_type_id=e8abf92b-bd04-4957-b57f-931390dc69fa)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Creating volume ca4b9ed5-a3d6-443b-beb4-b070b0759e87 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:42:48 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1197b18-e36f-48f0-ba6a-2bb886516ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be9df28-7fcf-47ea-aba3-97c95df8dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:48 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 1073741824 Sep 02 00:42:48 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Volume volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 (f8e305f3-8d0a-48d1-8d5b-96e4618a0475): created successfully Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be9df28-7fcf-47ea-aba3-97c95df8dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Flow 'volume_create_manager' (5bf0b221-a1ef-4cbe-993f-1d7d8c044a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-16903676-5f9e-45f3-83f8-0a58ad004156 tempest-AttachVolumeShelveTestJSON-1490910717 None] Created volume successfully. Sep 02 00:42:48 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 1073741824" returned: 0 in 0.586s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:48 devstack sudo[91981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 Sep 02 00:42:48 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-fd32f79b-5ac2-4347-83a7-11c268a663a5 req-0dd9e67a-2574-4411-8381-efede9fc2674 tempest-AttachVolumeTestJSON-2070218218 None] Terminate volume connection completed successfully. Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-fd32f79b-5ac2-4347-83a7-11c268a663a5 req-0dd9e67a-2574-4411-8381-efede9fc2674 tempest-AttachVolumeTestJSON-2070218218 None] Deleting attachment 51e1e5d4-940e-4562-b2a4-77706e46356c. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:42:49 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75058ec0-45ec-43e7-a1a3-d4966312ffde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2db17fc-fe0e-45ca-b711-7a8f11aabaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:42:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Volume volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 (ca4b9ed5-a3d6-443b-beb4-b070b0759e87): created successfully Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2db17fc-fe0e-45ca-b711-7a8f11aabaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Flow 'volume_create_manager' (d748e6e7-8ac8-490e-87ed-750936d11866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:42:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8bbb6243-a57c-4571-8e94-0a9e1020636b tempest-VolumeTypesAccessTest-1257778347 None] Created volume successfully. Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Acquiring lock "cinder-ca4b9ed5-a3d6-443b-beb4-b070b0759e87-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Lock "cinder-ca4b9ed5-a3d6-443b-beb4-b070b0759e87-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Acquiring lock "cinder-quobyte-ca4b9ed5-a3d6-443b-beb4-b070b0759e87" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Lock "cinder-quobyte-ca4b9ed5-a3d6-443b-beb4-b070b0759e87" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[59537271-0ba6-4ba0-8100-f00a0af3fa11]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:42:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:49 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 Sep 02 00:42:49 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:50 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87" returned: 0 in 0.483s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:50 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87 Sep 02 00:42:50 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:50 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ca4b9ed5-a3d6-443b-beb4-b070b0759e87" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Lock "cinder-quobyte-ca4b9ed5-a3d6-443b-beb4-b070b0759e87" released by "delete_volume" :: held 0.829s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:50 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-601172801 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-601172801, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:42:50 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-601172801 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-601172801, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Created reservations ['a5216e1a-2389-41be-acf6-4f61a39e6303', '1baff0bd-407c-4746-84e5-ac4e33bd7a39', '499a9307-36b2-4556-bd7c-d8b36ef5bb22', '1cc4297e-aeb4-4477-9d28-d8b75ef68bae'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:50 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:42:50 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:50 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:50 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:42:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Deleted volume successfully. Sep 02 00:42:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b3a5e64-53e0-4f89-8354-f1ac933d274f tempest-VolumeTypesAccessTest-1257778347 None] Lock "cinder-ca4b9ed5-a3d6-443b-beb4-b070b0759e87-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "cinder-b420bcab-58b6-4300-8a63-1dc6a8c79408-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-b420bcab-58b6-4300-8a63-1dc6a8c79408-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "cinder-quobyte-b420bcab-58b6-4300-8a63-1dc6a8c79408" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-quobyte-b420bcab-58b6-4300-8a63-1dc6a8c79408" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9414d87-9f93-4a2d-a2f9-14e37599c3b2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:42:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:55 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 Sep 02 00:42:55 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:56 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408" returned: 0 in 0.539s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:56 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408 Sep 02 00:42:56 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:56 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b420bcab-58b6-4300-8a63-1dc6a8c79408" returned: 0 in 0.397s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-quobyte-b420bcab-58b6-4300-8a63-1dc6a8c79408" released by "delete_volume" :: held 0.987s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Created reservations ['240d0fdf-7e77-425a-b154-2379c8e09ff0', 'e5e75d0a-7aa9-437f-b435-bf9e9f037199', 'a064768e-719e-42e7-b3ed-713eb6b2fea5', '9dc7bc6b-a939-4c17-bb1d-974afa6ba212'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:57 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:42:57 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:57 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:57 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:42:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Deleted volume successfully. Sep 02 00:42:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5442014a-2d6c-4b7e-a2d7-def06ecdf7e0 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-b420bcab-58b6-4300-8a63-1dc6a8c79408-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "cinder-19870f88-a13b-40e7-bb0f-e74cc2951733-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-19870f88-a13b-40e7-bb0f-e74cc2951733-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "cinder-quobyte-19870f88-a13b-40e7-bb0f-e74cc2951733" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-quobyte-19870f88-a13b-40e7-bb0f-e74cc2951733" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f51f552-0de4-4179-97ea-99f117f7d091]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:58 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 Sep 02 00:42:58 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:58 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:58 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733 Sep 02 00:42:58 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:58 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-19870f88-a13b-40e7-bb0f-e74cc2951733" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-quobyte-19870f88-a13b-40e7-bb0f-e74cc2951733" released by "delete_volume" :: held 0.834s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Created reservations ['396e762c-cebb-487a-9797-fded62dc78b6', '8da653a0-9341-4d85-9ad0-da6bcfcdca97', '2aa6d07e-5faa-4e3e-a878-ad09fd2a83a4', '81889e88-d6d9-4763-a36a-d1cbad5c4677'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:59 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:42:59 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "cinder-a7193b14-5aaf-4d9d-bfbe-6999d54070c1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-a7193b14-5aaf-4d9d-bfbe-6999d54070c1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "cinder-quobyte-a7193b14-5aaf-4d9d-bfbe-6999d54070c1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-quobyte-a7193b14-5aaf-4d9d-bfbe-6999d54070c1" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ec104-4a3b-487c-9938-ff728602541a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:42:59 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.456s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:42:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Deleted volume successfully. Sep 02 00:42:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6bb564da-a110-43dc-8990-2d39b5f98532 tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-19870f88-a13b-40e7-bb0f-e74cc2951733-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:42:59 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 Sep 02 00:42:59 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:00 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1" returned: 0 in 0.496s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:00 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1 Sep 02 00:43:00 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:00 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a7193b14-5aaf-4d9d-bfbe-6999d54070c1" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-quobyte-a7193b14-5aaf-4d9d-bfbe-6999d54070c1" released by "delete_volume" :: held 0.998s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Created reservations ['1b8c210c-910d-4b75-8d57-581e25ab70a3', '2fb8423c-3b30-49be-8059-06cf15a2942b', 'ae248e01-26a1-46b8-9cc2-0caf100aeb84', '311f2f4d-e80b-4d9f-8243-bdaf7e74d35d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:00 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:43:00 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:01 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:01 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:43:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Deleted volume successfully. Sep 02 00:43:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab36bb5f-5220-45e3-93cb-dde0469168dd tempest-AttachVolumeTestJSON-2070218218 None] Lock "cinder-a7193b14-5aaf-4d9d-bfbe-6999d54070c1-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:43:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-11032203-7a27-4940-9d2e-1e064b6e4cf6 req-ea5520c6-2763-4c53-bcdd-fc3c876ba368 tempest-AttachVolumeShelveTestJSON-1490910717 None] No connector for attachment 2d914a18-fb1a-4797-b50e-659486fd01ba; skipping storage backend terminate_connection call. {{(pid=87232) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 02 00:43:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-11032203-7a27-4940-9d2e-1e064b6e4cf6 req-ea5520c6-2763-4c53-bcdd-fc3c876ba368 tempest-AttachVolumeShelveTestJSON-1490910717 None] Deleting attachment 2d914a18-fb1a-4797-b50e-659486fd01ba. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Flow 'volume_create_manager' (74c0d95e-c88c-4e96-89e5-68fd6ec5f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a9228a-0bd0-458d-b0be-ca00e3ecfaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a9228a-0bd0-458d-b0be-ca00e3ecfaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1282320133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12afbcb-b610-48af-abee-4b873935aac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61249c5addc545cab6cf87cc29bce7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:43:11Z,use_quota=True,user_id='a94eee3a613744ec8300ecb002a1aab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a96be37-f3c5-40a9-8c09-93e86676197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a96be37-f3c5-40a9-8c09-93e86676197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eadcbf5-cbdc-4d3d-91e4-b9d4c74f91fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eadcbf5-cbdc-4d3d-91e4-b9d4c74f91fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12afbcb-b610-48af-abee-4b873935aac1', 'volume_name': 'volume-c12afbcb-b610-48af-abee-4b873935aac1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650a9f4f-0b4b-4704-b7e6-791c875ca2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650a9f4f-0b4b-4704-b7e6-791c875ca2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b82d7d-d45e-4d63-8f65-ce878339f74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Volume c12afbcb-b610-48af-abee-4b873935aac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12afbcb-b610-48af-abee-4b873935aac1', 'volume_size': 1} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1282320133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12afbcb-b610-48af-abee-4b873935aac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61249c5addc545cab6cf87cc29bce7dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:43:11Z,use_quota=True,user_id='a94eee3a613744ec8300ecb002a1aab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Creating volume c12afbcb-b610-48af-abee-4b873935aac1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:43:10 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:43:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:11 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 1073741824 Sep 02 00:43:11 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:11 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 1073741824" returned: 0 in 0.506s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:11 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 Sep 02 00:43:11 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:11 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b82d7d-d45e-4d63-8f65-ce878339f74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12afbcb-b610-48af-abee-4b873935aac1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d99f24-ef4b-4d44-ad7e-671903ac4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Volume volume-c12afbcb-b610-48af-abee-4b873935aac1 (c12afbcb-b610-48af-abee-4b873935aac1): created successfully Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d99f24-ef4b-4d44-ad7e-671903ac4400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Flow 'volume_create_manager' (74c0d95e-c88c-4e96-89e5-68fd6ec5f969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:43:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-283b760a-5d2b-4e4a-95b6-13c7d80311f4 tempest-VolumesMetadataTest-1587457264 None] Created volume successfully. Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:12 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:43:12 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:12 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 8 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:43:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:43:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Acquiring lock "cinder-c12afbcb-b610-48af-abee-4b873935aac1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:43:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Lock "cinder-c12afbcb-b610-48af-abee-4b873935aac1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:43:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Acquiring lock "cinder-quobyte-c12afbcb-b610-48af-abee-4b873935aac1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:43:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Lock "cinder-quobyte-c12afbcb-b610-48af-abee-4b873935aac1" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:43:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f28f40-3a24-4534-8e12-4ff1127dadb3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:43:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:14 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 Sep 02 00:43:14 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:15 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1" returned: 0 in 0.516s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:15 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1 Sep 02 00:43:15 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:15 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c12afbcb-b610-48af-abee-4b873935aac1" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Lock "cinder-quobyte-c12afbcb-b610-48af-abee-4b873935aac1" released by "delete_volume" :: held 0.997s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Created reservations ['4350a154-90e7-4293-9ad0-3a2400fd24ec', 'a45ba188-02ac-4ed2-b87d-fa83ee92b551', 'f14f836e-2685-429d-9878-f165abd5edc9', '76a320ec-ebe0-4234-bc61-dfe15544591b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:15 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:43:15 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:16 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:43:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Deleted volume successfully. Sep 02 00:43:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-28f74d9b-25dc-4aaa-a00e-eb8f7004eb2d tempest-VolumesMetadataTest-1587457264 None] Lock "cinder-c12afbcb-b610-48af-abee-4b873935aac1-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:43:25 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=38,cinder:UPDATE=53,cinder:DELETE=5,cinder:INSERT=11 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:43:26 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=29,cinder:UPDATE=44,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Flow 'volume_create_manager' (e1fb315b-ad67-4766-8b76-0865b45d4280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8e99e3-716c-40da-9cf9-9d89ceff334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8e99e3-716c-40da-9cf9-9d89ceff334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1283619394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125b8af5-8c62-492f-a590-c5706d73e113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c31d7cad2994bcb8ea5a2897448c1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:43:38Z,use_quota=True,user_id='15b70eb4a80e4d59b6efdf96633d60f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc50748-979c-4fc9-8cdd-8f54cbae2b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc50748-979c-4fc9-8cdd-8f54cbae2b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16051310-07c8-437c-947f-b4f9a3962273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16051310-07c8-437c-947f-b4f9a3962273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '125b8af5-8c62-492f-a590-c5706d73e113', 'volume_name': 'volume-125b8af5-8c62-492f-a590-c5706d73e113', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476b05f0-9a83-422f-b3d2-dfb16fb9e086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476b05f0-9a83-422f-b3d2-dfb16fb9e086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c4a0e8-a371-46a7-816e-69e31699e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Volume 125b8af5-8c62-492f-a590-c5706d73e113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-125b8af5-8c62-492f-a590-c5706d73e113', 'volume_size': 1} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1283619394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=125b8af5-8c62-492f-a590-c5706d73e113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c31d7cad2994bcb8ea5a2897448c1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:43:38Z,use_quota=True,user_id='15b70eb4a80e4d59b6efdf96633d60f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Creating volume 125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:43:37 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:43:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:38 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 1073741824 Sep 02 00:43:38 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:38 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 1073741824" returned: 0 in 0.659s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:38 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:43:38 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:39 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:43:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c4a0e8-a371-46a7-816e-69e31699e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-125b8af5-8c62-492f-a590-c5706d73e113', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db73a9c5-fecd-4011-b12e-304e0d6c7578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Volume volume-125b8af5-8c62-492f-a590-c5706d73e113 (125b8af5-8c62-492f-a590-c5706d73e113): created successfully Sep 02 00:43:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db73a9c5-fecd-4011-b12e-304e0d6c7578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Flow 'volume_create_manager' (e1fb315b-ad67-4766-8b76-0865b45d4280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:43:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-773142fa-1a21-40fe-b004-804d9daa47c7 tempest-VolumesActionsTest-2130024236 None] Created volume successfully. Sep 02 00:43:49 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:43:49 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:43:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bdfbe6d1-9bbf-4581-90e1-79cf09f02a6b tempest-VolumesActionsTest-2130024236 None] Acquiring lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113" by "attach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:43:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bdfbe6d1-9bbf-4581-90e1-79cf09f02a6b tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113" acquired by "attach_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:43:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bdfbe6d1-9bbf-4581-90e1-79cf09f02a6b tempest-VolumesActionsTest-2130024236 None] Attaching volume 125b8af5-8c62-492f-a590-c5706d73e113 to instance 1bc2afbd-7984-4529-b3c8-a04da37e3962 at mountpoint /dev/vdb on host None. Sep 02 00:43:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bdfbe6d1-9bbf-4581-90e1-79cf09f02a6b tempest-VolumesActionsTest-2130024236 None] Attach volume completed successfully. Sep 02 00:43:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bdfbe6d1-9bbf-4581-90e1-79cf09f02a6b tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113" released by "attach_volume" :: held 0.166s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:43:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-19187f15-99d2-48ca-85dd-9c53432f7875 tempest-VolumesActionsTest-2130024236 None] Acquiring lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:43:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-19187f15-99d2-48ca-85dd-9c53432f7875 tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:43:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-19187f15-99d2-48ca-85dd-9c53432f7875 tempest-VolumesActionsTest-2130024236 None] Detaching volume 125b8af5-8c62-492f-a590-c5706d73e113 from instance 1bc2afbd-7984-4529-b3c8-a04da37e3962. Sep 02 00:43:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-19187f15-99d2-48ca-85dd-9c53432f7875 tempest-VolumesActionsTest-2130024236 None] Detach volume completed successfully. Sep 02 00:43:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-19187f15-99d2-48ca-85dd-9c53432f7875 tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-detach_volume" released by "detach_volume" :: held 0.172s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Flow 'volume_create_manager' (ae11af81-9d1b-4e14-b7a3-b436461baeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb20ada-3f6c-48f0-8f7e-38ed06ab0433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb20ada-3f6c-48f0-8f7e-38ed06ab0433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1022451595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a5fb74-6277-49ef-a57c-fcea248e35c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742984327fe14726bfe5876c7ac5c945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:43:53Z,use_quota=True,user_id='e4f95a4760434a3085e55e39f87ee9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168bf006-352d-4f54-bf07-491b933bf4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168bf006-352d-4f54-bf07-491b933bf4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61fc4de-6d32-4f36-8fb1-90636cf4a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61fc4de-6d32-4f36-8fb1-90636cf4a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a5fb74-6277-49ef-a57c-fcea248e35c0', 'volume_name': 'volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd41c19-c73f-4a36-83f3-ccbb5b31c073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd41c19-c73f-4a36-83f3-ccbb5b31c073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc96a9d-9d11-4251-b2f8-96f68e85a761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Volume c4a5fb74-6277-49ef-a57c-fcea248e35c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0', 'volume_size': 1} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1022451595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a5fb74-6277-49ef-a57c-fcea248e35c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742984327fe14726bfe5876c7ac5c945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:43:53Z,use_quota=True,user_id='e4f95a4760434a3085e55e39f87ee9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Creating volume c4a5fb74-6277-49ef-a57c-fcea248e35c0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:43:53 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:43:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:53 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 1073741824 Sep 02 00:43:53 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:54 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 1073741824" returned: 0 in 0.970s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:54 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 Sep 02 00:43:54 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:43:55 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Sep 02 00:43:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0" returned: 0 in 0.584s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:43:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:43:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:43:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc96a9d-9d11-4251-b2f8-96f68e85a761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e56c1b-1926-46bb-a71d-bc280deccc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:43:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Volume volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 (c4a5fb74-6277-49ef-a57c-fcea248e35c0): created successfully Sep 02 00:43:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e56c1b-1926-46bb-a71d-bc280deccc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:43:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Flow 'volume_create_manager' (ae11af81-9d1b-4e14-b7a3-b436461baeb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:43:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9ab88812-86e3-47ea-b9a8-63c9fb1af47e tempest-ServerActionsTestOtherA-375885117 None] Created volume successfully. Sep 02 00:43:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Acquiring lock "cinder-f8e305f3-8d0a-48d1-8d5b-96e4618a0475-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:43:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "cinder-f8e305f3-8d0a-48d1-8d5b-96e4618a0475-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:43:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Acquiring lock "cinder-quobyte-f8e305f3-8d0a-48d1-8d5b-96e4618a0475" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:43:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "cinder-quobyte-f8e305f3-8d0a-48d1-8d5b-96e4618a0475" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:43:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b251f-9012-44f2-b9b2-025ebe5d3ddc]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:43:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:43:59 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 Sep 02 00:43:59 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:00 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475" returned: 0 in 0.801s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:00 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475 Sep 02 00:44:00 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:00 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f8e305f3-8d0a-48d1-8d5b-96e4618a0475" returned: 0 in 0.483s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "cinder-quobyte-f8e305f3-8d0a-48d1-8d5b-96e4618a0475" released by "delete_volume" :: held 1.374s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:44:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Created reservations ['4c4f6373-b9b5-4b48-ae84-a61965f61a03', 'dfde2f56-e0e9-44a7-9ff5-df5b6ce3cc67', '666ac8cb-e2f2-43f8-b079-c2b126111c2f', 'a5f61f7f-54de-4621-a166-3358bad9c99c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:01 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:44:01 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:01 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.512s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:44:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Deleted volume successfully. Sep 02 00:44:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a58e091d-b206-4435-87e8-cd4fefdc7b7f tempest-AttachVolumeShelveTestJSON-1490910717 None] Lock "cinder-f8e305f3-8d0a-48d1-8d5b-96e4618a0475-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:44:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-98ab9769-d558-4571-9647-3a44c721f4a1 tempest-VolumesActionsTest-2130024236 None] Acquiring lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113" by "attach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:44:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-98ab9769-d558-4571-9647-3a44c721f4a1 tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113" acquired by "attach_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:44:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-98ab9769-d558-4571-9647-3a44c721f4a1 tempest-VolumesActionsTest-2130024236 None] Attaching volume 125b8af5-8c62-492f-a590-c5706d73e113 to instance 2d6cac1d-33c4-44a7-bf2a-37ece26b9156 at mountpoint /dev/vdb on host None. Sep 02 00:44:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-98ab9769-d558-4571-9647-3a44c721f4a1 tempest-VolumesActionsTest-2130024236 None] Attach volume completed successfully. Sep 02 00:44:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-98ab9769-d558-4571-9647-3a44c721f4a1 tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113" released by "attach_volume" :: held 0.206s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:44:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9636d517-e117-48f0-a456-801ec2004d2c tempest-VolumesActionsTest-2130024236 None] Acquiring lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:44:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9636d517-e117-48f0-a456-801ec2004d2c tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:44:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9636d517-e117-48f0-a456-801ec2004d2c tempest-VolumesActionsTest-2130024236 None] Detaching volume 125b8af5-8c62-492f-a590-c5706d73e113 from instance 2d6cac1d-33c4-44a7-bf2a-37ece26b9156. Sep 02 00:44:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9636d517-e117-48f0-a456-801ec2004d2c tempest-VolumesActionsTest-2130024236 None] Detach volume completed successfully. Sep 02 00:44:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9636d517-e117-48f0-a456-801ec2004d2c tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-detach_volume" released by "detach_volume" :: held 0.222s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:12 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:44:12 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:12 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.622s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 8 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:44:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Flow 'volume_create_manager' (cb9076c2-14c9-445f-8617-6e14bf618060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f629bc56-9b12-4a43-bbbf-aac168e99d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f629bc56-9b12-4a43-bbbf-aac168e99d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-424240828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02598c8-00bc-46cd-958b-547e45f9b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3fd98f690b42e18a4986a967666ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:44:15Z,use_quota=True,user_id='05fa3be3da324cefb116d008e439afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0708b287-1473-42a1-9a57-22e4ddb98879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0708b287-1473-42a1-9a57-22e4ddb98879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dda00c-4e30-4ca3-b5e3-25ea8245babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dda00c-4e30-4ca3-b5e3-25ea8245babf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02598c8-00bc-46cd-958b-547e45f9b08c', 'volume_name': 'volume-e02598c8-00bc-46cd-958b-547e45f9b08c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b704e8-797e-40e9-aebf-412f68b97b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b704e8-797e-40e9-aebf-412f68b97b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53fcf76-310e-4897-b8c2-537d8e3e3bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Volume e02598c8-00bc-46cd-958b-547e45f9b08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02598c8-00bc-46cd-958b-547e45f9b08c', 'volume_size': 1} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-424240828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02598c8-00bc-46cd-958b-547e45f9b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3fd98f690b42e18a4986a967666ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:44:15Z,use_quota=True,user_id='05fa3be3da324cefb116d008e439afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Creating volume e02598c8-00bc-46cd-958b-547e45f9b08c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:44:15 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:44:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:15 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c 1073741824 Sep 02 00:44:15 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d6f90b3f-8b53-4c00-8030-91a2dbddc56d tempest-GroupSnapshotsV319Test-56794813 None] Group tempest-GroupSnapshotsV319Test-Group-55230682: creating Sep 02 00:44:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d6f90b3f-8b53-4c00-8030-91a2dbddc56d tempest-GroupSnapshotsV319Test-56794813 None] Group tempest-GroupSnapshotsV319Test-Group-55230682: created successfully Sep 02 00:44:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d6f90b3f-8b53-4c00-8030-91a2dbddc56d tempest-GroupSnapshotsV319Test-56794813 None] Create group completed successfully. Sep 02 00:44:16 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c 1073741824" returned: 0 in 0.733s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:16 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c Sep 02 00:44:16 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:16 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c" returned: 0 in 0.335s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53fcf76-310e-4897-b8c2-537d8e3e3bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02598c8-00bc-46cd-958b-547e45f9b08c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57555449-a7f6-4bb4-9080-9eb6330354f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Volume volume-e02598c8-00bc-46cd-958b-547e45f9b08c (e02598c8-00bc-46cd-958b-547e45f9b08c): created successfully Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57555449-a7f6-4bb4-9080-9eb6330354f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Flow 'volume_create_manager' (cb9076c2-14c9-445f-8617-6e14bf618060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:44:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-96b8f4c9-8465-45bb-8822-063dba01475a tempest-AttachVolumeNegativeTest-298902001 None] Created volume successfully. Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf27303c-e188-4540-906b-86cf785d5ea2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:17 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:44:17 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:17 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[87092615-0b1a-4713-bfc3-6b404d3b00b0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:17 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:44:17 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:44:17 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Flow 'volume_create_manager' (37b10a8b-98e1-467d-be8d-b7f63c2b4d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d3dda1-209c-4f18-8920-9b99fb023515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.562s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.4134394e-e25b-47dc-b567-066ac45e18a7gc1b6ydq.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d3dda1-209c-4f18-8920-9b99fb023515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394842498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dafae9d-0c72-4e53-947e-6135cc4a0e99,host='devstack@QuobyteHD#QuobyteHD',id=0fcd5d70-a55a-435d-8f2c-ee387d445cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760e4ad84787432cb944c989fa0f0fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:44:18Z,use_quota=True,user_id='ea251e849a894cc0980a49623f5e8917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd567775-2594-4b5c-bc38-8fa5294c71c0),volume_type_id=bd567775-2594-4b5c-bc38-8fa5294c71c0)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f0be98-80d6-46aa-a5c4-4eccdc053a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f0be98-80d6-46aa-a5c4-4eccdc053a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bf8fba-8ea8-4349-9553-18df2cc5d5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bf8fba-8ea8-4349-9553-18df2cc5d5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fcd5d70-a55a-435d-8f2c-ee387d445cdd', 'volume_name': 'volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf3dcc2-0238-4187-b569-cf8409e10422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:17 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.4134394e-e25b-47dc-b567-066ac45e18a7gc1b6ydq.img Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf3dcc2-0238-4187-b569-cf8409e10422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61abee1-9959-4d1f-97ba-7b23ff577995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:17 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Volume 0fcd5d70-a55a-435d-8f2c-ee387d445cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd', 'volume_size': 1} Sep 02 00:44:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8a2293b8-ebf0-4434-840f-bed7cdb49c49 req-175cc546-60fe-4e7d-a22b-cf250a7a4e65 tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:23 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.4134394e-e25b-47dc-b567-066ac45e18a7gc1b6ydq.img" returned: 0 in 6.003s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1041344-e510-477e-b61a-ce8005c89cc8]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:24 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:44:24 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:24 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.580s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:24 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.4134394e-e25b-47dc-b567-066ac45e18a7gc1b6ydq.img {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:44:24 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Converted 1024.00 MB image at 170.56 MB/s Sep 02 00:44:24 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] 4134394e-e25b-47dc-b567-066ac45e18a7 was raw, no need to convert to raw {{(pid=87232) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 00:44:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=29,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:44:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=26,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:44:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-b5579ab8-6061-40a7-9a9c-d751221dc762 req-6afc9c78-0393-4b15-a2fd-0e8ad72274ed tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.906s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Uploaded volume to glance image-id: 4134394e-e25b-47dc-b567-066ac45e18a7. {{(pid=87232) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.834s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2dafae9d-0c72-4e53-947e-6135cc4a0e99,created_at=2026-09-01T22:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394842498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dafae9d-0c72-4e53-947e-6135cc4a0e99,host='devstack@QuobyteHD#QuobyteHD',id=0fcd5d70-a55a-435d-8f2c-ee387d445cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760e4ad84787432cb944c989fa0f0fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:44:18Z,use_quota=True,user_id='ea251e849a894cc0980a49623f5e8917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd567775-2594-4b5c-bc38-8fa5294c71c0),volume_type_id=bd567775-2594-4b5c-bc38-8fa5294c71c0)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Creating volume 0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:44:43 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:44:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:43 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd 1073741824 Sep 02 00:44:43 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9dd9fc26-ea88-469f-9220-508d3765799a tempest-VolumesActionsTest-2130024236 None] Copy volume to image completed successfully. Sep 02 00:44:44 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd 1073741824" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:44 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd Sep 02 00:44:44 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:44 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" returned: 0 in 0.237s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8a2293b8-ebf0-4434-840f-bed7cdb49c49 req-175cc546-60fe-4e7d-a22b-cf250a7a4e65 tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.137s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61abee1-9959-4d1f-97ba-7b23ff577995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9c0673-21dd-4f66-a7bb-6da085927fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8a2293b8-ebf0-4434-840f-bed7cdb49c49 req-175cc546-60fe-4e7d-a22b-cf250a7a4e65 tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.088s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-b5579ab8-6061-40a7-9a9c-d751221dc762 req-6afc9c78-0393-4b15-a2fd-0e8ad72274ed tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.232s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Volume volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd (0fcd5d70-a55a-435d-8f2c-ee387d445cdd): created successfully Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9c0673-21dd-4f66-a7bb-6da085927fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Flow 'volume_create_manager' (37b10a8b-98e1-467d-be8d-b7f63c2b4d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:44:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c80cdbd9-5f5b-49ae-b023-e746268ee461 tempest-GroupSnapshotsV319Test-56794813 None] Created volume successfully. Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-b5579ab8-6061-40a7-9a9c-d751221dc762 req-6afc9c78-0393-4b15-a2fd-0e8ad72274ed tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.097s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-8a2293b8-ebf0-4434-840f-bed7cdb49c49 req-175cc546-60fe-4e7d-a22b-cf250a7a4e65 tempest-AttachVolumeNegativeTest-298902001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-e02598c8-00bc-46cd-958b-547e45f9b08c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cf8241e-9d9c-4378-ad73-2d563329289a', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:44:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-b5579ab8-6061-40a7-9a9c-d751221dc762 req-6afc9c78-0393-4b15-a2fd-0e8ad72274ed tempest-ServerActionsTestOtherA-375885117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76dd8c59-e754-4a8a-ae7d-c7d6aa221309', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:44:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-8a2293b8-ebf0-4434-840f-bed7cdb49c49 req-175cc546-60fe-4e7d-a22b-cf250a7a4e65 tempest-AttachVolumeNegativeTest-298902001 None] attachment_update completed successfully. Sep 02 00:44:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-b5579ab8-6061-40a7-9a9c-d751221dc762 req-6afc9c78-0393-4b15-a2fd-0e8ad72274ed tempest-ServerActionsTestOtherA-375885117 None] attachment_update completed successfully. Sep 02 00:44:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] GroupSnapshot 99197dd7-158f-4ab7-b034-d56a1d73077d: creating. Sep 02 00:44:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Group snapshot 99197dd7-158f-4ab7-b034-d56a1d73077d: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 00:44:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Creating offline snapshot 5e9f1ab8-d25e-4f3b-a72a-b14867be6449 of volume 0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:44:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b741f0f2-3e6a-43b2-81d4-fc3b76e49c43]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:45 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd Sep 02 00:44:45 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:46 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" returned: 0 in 0.448s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:46 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 1G Sep 02 00:44:46 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:46 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 1G" returned: 0 in 0.568s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:46 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 Sep 02 00:44:46 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:47 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:47 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:44:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:47 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 Sep 02 00:44:47 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:47 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:47 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.info Sep 02 00:44:47 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:47 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.info" returned: 0 in 0.353s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:47 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:44:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:47 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.info Sep 02 00:44:47 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:48 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.info" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.694s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d253469-1913-44d2-93ce-b9fdd7b1764d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4dbd20ab-3708-41b9-bff2-15b05cdbdc33 tempest-GroupSnapshotsV319Test-56794813 None] group_snapshot 99197dd7-158f-4ab7-b034-d56a1d73077d: created successfully Sep 02 00:44:48 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:44:48 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a96a1be4-141b-4f00-bddd-aa1aab6dd94f req-adc2954a-df3f-4471-a0db-4df351685fbf tempest-ServerActionsTestOtherA-375885117 None] Terminate volume connection completed successfully. Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-a96a1be4-141b-4f00-bddd-aa1aab6dd94f req-adc2954a-df3f-4471-a0db-4df351685fbf tempest-ServerActionsTestOtherA-375885117 None] Deleting attachment 76dd8c59-e754-4a8a-ae7d-c7d6aa221309. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:44:48 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce303d9-329b-48f4-99c0-667142ad4fca]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:48 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:44:48 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:49 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.753s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:49 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img Sep 02 00:44:49 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a96a1be4-141b-4f00-bddd-aa1aab6dd94f req-02147325-e289-4e5d-908a-43844671c5ea tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] group_snapshot 99197dd7-158f-4ab7-b034-d56a1d73077d: deleting Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] group_snapshot 99197dd7-158f-4ab7-b034-d56a1d73077d: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Acquiring lock "cinder-quobyte-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Lock "cinder-quobyte-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Acquiring lock "cinder-quobyte-5e9f1ab8-d25e-4f3b-a72a-b14867be6449" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Lock "cinder-quobyte-5e9f1ab8-d25e-4f3b-a72a-b14867be6449" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Deleting offline snapshot 5e9f1ab8-d25e-4f3b-a72a-b14867be6449 of volume 0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] snapshot_file for this snap is: volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef72f555-b97f-493b-b2b7-0faf19cb7fc7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:49 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 Sep 02 00:44:49 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:50 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449" returned: 0 in 1.018s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:44:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a38407-48d4-4895-8dc7-dfd8456ea285]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:51 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd Sep 02 00:44:51 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:52 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" returned: 0 in 1.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:52 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 Sep 02 00:44:52 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:53 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449" returned: 0 in 0.881s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:53 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449 Sep 02 00:44:53 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:53 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd.5e9f1ab8-d25e-4f3b-a72a-b14867be6449" returned: 0 in 0.560s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Lock "cinder-quobyte-5e9f1ab8-d25e-4f3b-a72a-b14867be6449" released by "_delete_snapshot" :: held 4.102s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:44:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Lock "cinder-quobyte-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" released by "delete_snapshot" :: held 4.148s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:44:54 devstack cinder-volume[87232]: WARNING cinder.quota [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-413543989 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-413543989, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:44:54 devstack cinder-volume[87232]: WARNING cinder.quota [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-413543989 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-413543989, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:44:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] Created reservations ['121a2fa8-05a1-4a21-88f2-500e3734f999', 'f5d0adbc-5a80-4b04-a2d3-eae5f86b5307', '85bf6b6c-e7a6-4f59-a4eb-ca30285fa677', '19bce632-ec51-4470-bd4a-9d8960d7f3f7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:44:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e30c484d-18e9-4678-b032-fbd553ca3443 tempest-GroupSnapshotsV319Test-56794813 None] group_snapshot 99197dd7-158f-4ab7-b034-d56a1d73077d: deleted successfully Sep 02 00:44:54 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img" returned: 0 in 5.633s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad5643a-56c1-4fff-8bc3-a6e704bfa2e7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Acquiring lock "cinder-quobyte-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Lock "cinder-quobyte-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:44:55 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:44:55 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc192bf-f0c1-40bc-b625-2e317508c92c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:55 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd Sep 02 00:44:55 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:55 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" returned: 0 in 0.455s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:55 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.662s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:44:55 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Converted 1024.00 MB image at 181.75 MB/s Sep 02 00:44:55 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd Sep 02 00:44:55 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e was raw, converting to qcow2 {{(pid=87232) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[da87dc66-e9ae-435b-92f2-12f55a6a4552]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:55 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img Sep 02 00:44:55 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:55 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Lock "cinder-quobyte-0fcd5d70-a55a-435d-8f2c-ee387d445cdd" released by "delete_volume" :: held 0.935s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Created reservations ['7c5d81c6-22fd-456a-b977-c1881d0fcadf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:44:56 devstack cinder-volume[87232]: WARNING cinder.quota [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-413543989 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-413543989, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:44:56 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Created reservations ['a8fb8298-c9a7-48b0-976f-e64488c09867', '99a01d53-1807-4052-bf0f-6fce9faaa90e', '24f62412-8f7b-41c9-8cb9-ed8d85065c26', 'fd50a7d4-ca99-4d10-9784-85288e342862'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:44:56 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img Sep 02 00:44:56 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:56 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:44:56 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:56 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img" returned: 1 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img /opt/stack/data/cinder/conversion/vol_upload_jocz6wrt {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:56 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img /opt/stack/data/cinder/conversion/vol_upload_jocz6wrt Sep 02 00:44:56 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:56 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.317s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:44:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8f921575-f025-4051-8cac-5f5540521031 tempest-GroupSnapshotsV319Test-56794813 None] Delete group completed successfully. Sep 02 00:44:56 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img /opt/stack/data/cinder/conversion/vol_upload_jocz6wrt" returned: 0 in 0.320s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Image conversion details: src /opt/stack/data/cinder/conversion/125b8af5-8c62-492f-a590-c5706d73e113.temp_image.d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e5uki6z7g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jocz6wrt {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:44:56 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[373764bc-477d-4db5-b2e6-73eff6b3dd2f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:44:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jocz6wrt {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:44:57 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jocz6wrt Sep 02 00:44:57 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:44:57 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 02 00:44:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jocz6wrt" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:44:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.505s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Uploaded volume to glance image-id: d0ad6e08-5e86-4245-b9ed-b4ef3aacfb7e. {{(pid=87232) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 00:44:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a96a1be4-141b-4f00-bddd-aa1aab6dd94f req-02147325-e289-4e5d-908a-43844671c5ea tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:44:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a96a1be4-141b-4f00-bddd-aa1aab6dd94f req-02147325-e289-4e5d-908a-43844671c5ea tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:44:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-60ecdb3e-8168-4a69-937b-26a31af327cc tempest-VolumesActionsTest-2130024236 None] Copy volume to image completed successfully. Sep 02 00:44:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-a96a1be4-141b-4f00-bddd-aa1aab6dd94f req-02147325-e289-4e5d-908a-43844671c5ea tempest-ServerActionsTestOtherA-375885117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8038eda3-92df-4dab-affe-1e636180f0d0', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:44:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a96a1be4-141b-4f00-bddd-aa1aab6dd94f req-02147325-e289-4e5d-908a-43844671c5ea tempest-ServerActionsTestOtherA-375885117 None] attachment_update completed successfully. Sep 02 00:45:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Acquiring lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Acquiring lock "cinder-quobyte-125b8af5-8c62-492f-a590-c5706d73e113" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Lock "cinder-quobyte-125b8af5-8c62-492f-a590-c5706d73e113" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c167f7-dec7-4e8d-a054-52e581752533]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:01 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:45:01 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:02 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.768s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:02 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113 Sep 02 00:45:02 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:02 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-125b8af5-8c62-492f-a590-c5706d73e113" returned: 0 in 0.498s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Lock "cinder-quobyte-125b8af5-8c62-492f-a590-c5706d73e113" released by "delete_volume" :: held 1.348s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Created reservations ['b730c0f7-a59d-460a-b9ec-5f0d68f742b2', 'ae73e12d-8a15-439b-a247-5ee7f1cce07d', 'c8b24cd4-f09e-4169-b895-37bad0339f65', '763acaa3-aabd-4444-8cfa-deff70ae9ce7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:03 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:45:03 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:03 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:45:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Deleted volume successfully. Sep 02 00:45:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-deb75b52-dca6-4934-91bb-9c0f1096ea5b tempest-VolumesActionsTest-2130024236 None] Lock "cinder-125b8af5-8c62-492f-a590-c5706d73e113-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:12 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:45:12 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:12 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:45:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:45:13 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=44,cinder:INSERT=6,cinder:UPDATE=31 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:45:13 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=54,cinder:UPDATE=39,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (cf9cee3a-a060-44d5-a85b-67b6641141e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90874672-6acb-4592-9895-8bc6c5a4e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90874672-6acb-4592-9895-8bc6c5a4e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-352117006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe7643d-1b5c-480c-9586-cea2452c69d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:15Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e618f96-bd51-46da-9eaa-98906816d345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e618f96-bd51-46da-9eaa-98906816d345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82e7cbe-a077-44fc-a02f-75eaa8800c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82e7cbe-a077-44fc-a02f-75eaa8800c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe7643d-1b5c-480c-9586-cea2452c69d2', 'volume_name': 'volume-8fe7643d-1b5c-480c-9586-cea2452c69d2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fda14c3-d686-4d24-b81a-9395b588ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fda14c3-d686-4d24-b81a-9395b588ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98875d37-15c0-4177-889f-f1b6294b53e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Volume 8fe7643d-1b5c-480c-9586-cea2452c69d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe7643d-1b5c-480c-9586-cea2452c69d2', 'volume_size': 1} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-352117006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe7643d-1b5c-480c-9586-cea2452c69d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:15Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Creating volume 8fe7643d-1b5c-480c-9586-cea2452c69d2 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:45:15 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:15 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 1073741824 Sep 02 00:45:15 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:15 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 1073741824" returned: 0 in 0.554s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:15 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 Sep 02 00:45:15 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:15 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2" returned: 0 in 0.278s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98875d37-15c0-4177-889f-f1b6294b53e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe7643d-1b5c-480c-9586-cea2452c69d2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa30f8c-c2cf-44d7-a19d-90bb57fcc7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Volume volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 (8fe7643d-1b5c-480c-9586-cea2452c69d2): created successfully Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa30f8c-c2cf-44d7-a19d-90bb57fcc7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (cf9cee3a-a060-44d5-a85b-67b6641141e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dd150be7-6099-411e-aaa2-e0494fd054b1 tempest-VolumesGetTest-1014201995 None] Created volume successfully. Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (bd1d8032-14d1-4c86-85df-37b60ae2f633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f6f1a1-fb08-469f-bd9c-bf27bec49b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f6f1a1-fb08-469f-bd9c-bf27bec49b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1036308537',display_name='tempest-VolumesGetTest-Volume-108642462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9f0838-51ab-4124-be6a-c5b6bbf33a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:18Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158563aa-daf1-4729-a549-588b085912bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158563aa-daf1-4729-a549-588b085912bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab8fe95-6789-4f62-9327-2a97499684f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab8fe95-6789-4f62-9327-2a97499684f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9f0838-51ab-4124-be6a-c5b6bbf33a2b', 'volume_name': 'volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da5243c-a907-491e-a94b-a9dec1418630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da5243c-a907-491e-a94b-a9dec1418630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28db35d-0b1c-4615-83b5-7061425f050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Volume bc9f0838-51ab-4124-be6a-c5b6bbf33a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b', 'volume_size': 1} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1036308537',display_name='tempest-VolumesGetTest-Volume-108642462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9f0838-51ab-4124-be6a-c5b6bbf33a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:18Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Creating volume bc9f0838-51ab-4124-be6a-c5b6bbf33a2b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:45:17 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:45:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:18 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b 1073741824 Sep 02 00:45:18 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:18 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b 1073741824" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:18 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b Sep 02 00:45:18 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:18 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28db35d-0b1c-4615-83b5-7061425f050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fde792-24b7-4eb1-b129-726c7a708ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Volume volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b (bc9f0838-51ab-4124-be6a-c5b6bbf33a2b): created successfully Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fde792-24b7-4eb1-b129-726c7a708ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (bd1d8032-14d1-4c86-85df-37b60ae2f633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-efc4f2a8-3de5-48a3-92ab-d648713a006a tempest-VolumesGetTest-1014201995 None] Created volume successfully. Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Lock "cinder-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da36df7-dd5d-4149-bad6-2cfed7cd2bcd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:20 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b Sep 02 00:45:20 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:20 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b" returned: 0 in 0.415s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:20 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b Sep 02 00:45:20 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:20 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b" released by "delete_volume" :: held 0.801s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Created reservations ['c54e68f7-9262-486c-9979-ecdc3b84bf7a', '7e80d598-379b-454b-bf95-94e8f4b82cb8', '571b239f-6698-41bd-a3f5-e90d76cb2cc5', '40a386b0-7185-4fa5-8fe4-d965fca8359f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:21 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:45:21 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-8fe7643d-1b5c-480c-9586-cea2452c69d2-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:21 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Lock "cinder-8fe7643d-1b5c-480c-9586-cea2452c69d2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:45:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Deleted volume successfully. Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-8fe7643d-1b5c-480c-9586-cea2452c69d2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d86d6bac-2873-4fd2-bca3-a3e4aeeba76f tempest-VolumesGetTest-1014201995 None] Lock "cinder-bc9f0838-51ab-4124-be6a-c5b6bbf33a2b-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-8fe7643d-1b5c-480c-9586-cea2452c69d2" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c96c754-7dd4-4f75-80de-1e9ddd538102]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:21 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 Sep 02 00:45:21 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:21 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:22 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2 Sep 02 00:45:22 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:22 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8fe7643d-1b5c-480c-9586-cea2452c69d2" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-8fe7643d-1b5c-480c-9586-cea2452c69d2" released by "delete_volume" :: held 0.759s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Created reservations ['2794888f-7ac8-4494-9d7e-7e3933aa5de1', '81ae1fc6-cfdd-47fa-b56a-b90c66757faf', 'd7195e44-1842-470f-96c4-d1ddf9cb003e', 'fa4dada5-5cb2-4856-814f-4d697e8d7c91'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:22 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:45:22 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:22 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.313s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:45:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Deleted volume successfully. Sep 02 00:45:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08e7414b-9663-4324-8a24-15cd497c4f69 tempest-VolumesGetTest-1014201995 None] Lock "cinder-8fe7643d-1b5c-480c-9586-cea2452c69d2-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (2fdaaf0b-0bb0-4166-94a1-dbc7413b03c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4361fc-c272-4151-9f30-b6d99ee24e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4361fc-c272-4151-9f30-b6d99ee24e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1883990125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ac88b2-1b0f-4fb5-b81f-788874aca36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:23Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dea0e67-c768-463d-af7c-ff4b29992588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dea0e67-c768-463d-af7c-ff4b29992588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bb4a55-30b7-44e8-85ae-dd025100a4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bb4a55-30b7-44e8-85ae-dd025100a4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ac88b2-1b0f-4fb5-b81f-788874aca36e', 'volume_name': 'volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45f4772-1913-4ef8-9a51-5cda33d1fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45f4772-1913-4ef8-9a51-5cda33d1fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feab8e97-6c9a-4573-bbda-2a62a3a6858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Volume 70ac88b2-1b0f-4fb5-b81f-788874aca36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e', 'volume_size': 1} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1883990125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ac88b2-1b0f-4fb5-b81f-788874aca36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:23Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Creating volume 70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:45:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:23 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e 1073741824 Sep 02 00:45:23 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:23 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e 1073741824" returned: 0 in 0.481s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:23 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e Sep 02 00:45:23 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:24 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:45:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feab8e97-6c9a-4573-bbda-2a62a3a6858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6ce3b5-5929-47fb-8502-7082fee03fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Volume volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e (70ac88b2-1b0f-4fb5-b81f-788874aca36e): created successfully Sep 02 00:45:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6ce3b5-5929-47fb-8502-7082fee03fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (2fdaaf0b-0bb0-4166-94a1-dbc7413b03c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-105d9fed-a446-4210-8fa2-fa90e727c2d7 tempest-VolumesGetTest-1014201995 None] Created volume successfully. Sep 02 00:45:25 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:45:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (bff352e4-4a71-4c7c-8681-19221c67cb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5576c76-ffc9-4882-8f81-bb77ebc32058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5576c76-ffc9-4882-8f81-bb77ebc32058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2005920413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0526a124-bc5f-45ab-9300-e1c41b77eff0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=70ac88b2-1b0f-4fb5-b81f-788874aca36e,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:26Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a16c636-5d81-4c05-b4ef-be864e7396c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a16c636-5d81-4c05-b4ef-be864e7396c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c19d06-0bf2-4d89-ac4e-6be283c251a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c19d06-0bf2-4d89-ac4e-6be283c251a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0526a124-bc5f-45ab-9300-e1c41b77eff0', 'volume_name': 'volume-0526a124-bc5f-45ab-9300-e1c41b77eff0', 'volume_size': 1, 'source_volid': '70ac88b2-1b0f-4fb5-b81f-788874aca36e', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd755061-cef8-4b08-9025-ff387f10b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd755061-cef8-4b08-9025-ff387f10b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e261bc68-98be-414f-95c3-e2cdb8d7976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Volume 0526a124-bc5f-45ab-9300-e1c41b77eff0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0526a124-bc5f-45ab-9300-e1c41b77eff0', 'volume_size': 1, 'source_volid': '70ac88b2-1b0f-4fb5-b81f-788874aca36e', 'source_volstatus': 'available'} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:26 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Cloning volume 70ac88b2-1b0f-4fb5-b81f-788874aca36e to volume 0526a124-bc5f-45ab-9300-e1c41b77eff0 Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Creating offline snapshot 9f9a918e-31c7-45fd-8787-ff4e037dfc16 of volume 70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3be91-3253-4e7a-a643-4bf526a7aea5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:26 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e Sep 02 00:45:26 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:26 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e" returned: 0 in 0.695s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:26 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 1G Sep 02 00:45:26 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:27 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 1G" returned: 0 in 0.587s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:27 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 Sep 02 00:45:27 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:27 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:27 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 is being set with open permissions: ugo+rw Sep 02 00:45:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:27 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 Sep 02 00:45:27 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:28 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16" returned: 0 in 0.488s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:28 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.info Sep 02 00:45:28 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:28 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.info" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:28 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.info is being set with open permissions: ugo+rw Sep 02 00:45:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:28 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.info Sep 02 00:45:28 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:29 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.info" returned: 0 in 0.299s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-0526a124-bc5f-45ab-9300-e1c41b77eff0" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-0526a124-bc5f-45ab-9300-e1c41b77eff0" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] snapshot: 9f9a918e-31c7-45fd-8787-ff4e037dfc16, volume: 0526a124-bc5f-45ab-9300-e1c41b77eff0, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[407c1ffe-da95-4010-bc9c-1cc47bbd90fb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:29 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 Sep 02 00:45:29 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:29 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16" returned: 0 in 0.540s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5203e5ad-917b-4897-999d-fd82642280cf]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:29 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e Sep 02 00:45:29 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:30 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e" returned: 0 in 0.514s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:45:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:45:30 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:45:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:30 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 Sep 02 00:45:30 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-7ae2d40b-920b-4325-b49b-b87e3362b055 req-c0d5e13b-8f82-493e-b9b9-1f8334955287 tempest-AttachVolumeNegativeTest-298902001 None] Terminate volume connection completed successfully. Sep 02 00:45:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-7ae2d40b-920b-4325-b49b-b87e3362b055 req-c0d5e13b-8f82-493e-b9b9-1f8334955287 tempest-AttachVolumeNegativeTest-298902001 None] Deleting attachment 7cf8241e-9d9c-4378-ad73-2d563329289a. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:45:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-ca2d9a94-4991-4a39-aa3b-8a534a6c1edf req-23cc1d00-1d9b-4580-9f6a-53e2a7270281 tempest-ServerActionsTestOtherA-375885117 None] Terminate volume connection completed successfully. Sep 02 00:45:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-ca2d9a94-4991-4a39-aa3b-8a534a6c1edf req-23cc1d00-1d9b-4580-9f6a-53e2a7270281 tempest-ServerActionsTestOtherA-375885117 None] Deleting attachment 8038eda3-92df-4dab-affe-1e636180f0d0. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:45:37 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0" returned: 0 in 6.989s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:45:37 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Converted 1024.00 MB image at 146.50 MB/s Sep 02 00:45:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 is being set with open permissions: ugo+rw Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:37 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 Sep 02 00:45:37 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:37 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0" returned: 0 in 0.465s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-0526a124-bc5f-45ab-9300-e1c41b77eff0" released by "_copy_volume_from_snapshot" :: held 8.646s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-9f9a918e-31c7-45fd-8787-ff4e037dfc16" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-9f9a918e-31c7-45fd-8787-ff4e037dfc16" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Deleting offline snapshot 9f9a918e-31c7-45fd-8787-ff4e037dfc16 of volume 70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] snapshot_file for this snap is: volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea9c1b0-b3ec-42f9-baeb-51a51769b1a3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:38 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 Sep 02 00:45:38 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:38 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16" returned: 0 in 0.648s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:45:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[477921ca-b379-4b91-9371-0e7a988a969c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:38 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e Sep 02 00:45:38 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:39 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e" returned: 0 in 0.678s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:39 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 Sep 02 00:45:39 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:39 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16" returned: 0 in 0.525s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:39 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16 Sep 02 00:45:39 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:40 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e.9f9a918e-31c7-45fd-8787-ff4e037dfc16" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-9f9a918e-31c7-45fd-8787-ff4e037dfc16" released by "_delete_snapshot" :: held 2.289s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.071s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e261bc68-98be-414f-95c3-e2cdb8d7976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0526a124-bc5f-45ab-9300-e1c41b77eff0', 'volume_size': 1, 'source_volid': '70ac88b2-1b0f-4fb5-b81f-788874aca36e', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd66269-57af-48d7-9a64-2564a725b1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Volume volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 (0526a124-bc5f-45ab-9300-e1c41b77eff0): created successfully Sep 02 00:45:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd66269-57af-48d7-9a64-2564a725b1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (bff352e4-4a71-4c7c-8681-19221c67cb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-51cbb101-94c3-4b04-8935-96a922252105 tempest-VolumesGetTest-1014201995 None] Created volume successfully. Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (a98a6a2b-d15f-4ee6-9af7-74ff0ed8128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647904cc-82e4-4cfb-a6b6-7a3cf332bff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647904cc-82e4-4cfb-a6b6-7a3cf332bff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-336608586',display_name='tempest-VolumesGetTest-Volume-1309974672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5d501c-6462-4b7c-956f-5dcda9fa995b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:41Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acd7531-553f-4a02-8090-45a27131dea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acd7531-553f-4a02-8090-45a27131dea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b99886f-31bd-432e-8f98-046216a939e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b99886f-31bd-432e-8f98-046216a939e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5d501c-6462-4b7c-956f-5dcda9fa995b', 'volume_name': 'volume-db5d501c-6462-4b7c-956f-5dcda9fa995b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc4f68-474c-43f7-a323-bb0541dd6763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc4f68-474c-43f7-a323-bb0541dd6763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035bf954-815f-47de-841a-702da6d2bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Volume db5d501c-6462-4b7c-956f-5dcda9fa995b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5d501c-6462-4b7c-956f-5dcda9fa995b', 'volume_size': 1} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-336608586',display_name='tempest-VolumesGetTest-Volume-1309974672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5d501c-6462-4b7c-956f-5dcda9fa995b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:41Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Creating volume db5d501c-6462-4b7c-956f-5dcda9fa995b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:45:41 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:45:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:41 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b 1073741824 Sep 02 00:45:41 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:42 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b 1073741824" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:42 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b Sep 02 00:45:42 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:42 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035bf954-815f-47de-841a-702da6d2bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5d501c-6462-4b7c-956f-5dcda9fa995b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1d22f9-9fd9-4b8a-b973-d25cab13e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Volume volume-db5d501c-6462-4b7c-956f-5dcda9fa995b (db5d501c-6462-4b7c-956f-5dcda9fa995b): created successfully Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1d22f9-9fd9-4b8a-b973-d25cab13e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (a98a6a2b-d15f-4ee6-9af7-74ff0ed8128e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b37fd0f2-4779-499d-9137-01d4c59cbc02 tempest-VolumesGetTest-1014201995 None] Created volume successfully. Sep 02 00:45:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-db5d501c-6462-4b7c-956f-5dcda9fa995b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Lock "cinder-db5d501c-6462-4b7c-956f-5dcda9fa995b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-db5d501c-6462-4b7c-956f-5dcda9fa995b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-db5d501c-6462-4b7c-956f-5dcda9fa995b" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efebfb1-20c1-437d-b210-16ae7cc5ca58]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:44 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b Sep 02 00:45:44 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:44 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:44 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b Sep 02 00:45:44 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Flow 'volume_create_manager' (292760a3-bedd-4928-badc-64bae6180106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdb4c31-3c69-48f4-a036-b91c045340a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffdb4c31-3c69-48f4-a036-b91c045340a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1097508945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742984327fe14726bfe5876c7ac5c945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:45Z,use_quota=True,user_id='e4f95a4760434a3085e55e39f87ee9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edfcdd6-6e24-46ce-9511-01957d6b6462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edfcdd6-6e24-46ce-9511-01957d6b6462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4cc1e8-8acc-42f7-868d-30e7a1462670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:45:44 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-db5d501c-6462-4b7c-956f-5dcda9fa995b" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-db5d501c-6462-4b7c-956f-5dcda9fa995b" released by "delete_volume" :: held 1.095s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Created reservations ['9f8c87e7-f1e8-4c6c-b29c-70d2a957a628', '5e091bae-6c96-4bea-8527-2192cb3d0e31', '1e261c91-d3f3-421f-be15-00221dda8881', 'f52dff4b-2cdc-4710-aeb5-3bc69777e814'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4cc1e8-8acc-42f7-868d-30e7a1462670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0', 'volume_name': 'volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f604af-2d4e-4d03-9273-4ec8bce41abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f604af-2d4e-4d03-9273-4ec8bce41abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee0c967-2a2f-47c0-bf62-2d8121e10194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Volume 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Trying to clone 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:45 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:45:45 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:45 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:45:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Deleted volume successfully. Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:45:45 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2ac5e17-b0e3-4fe2-a907-821f41fda567 tempest-VolumesGetTest-1014201995 None] Lock "cinder-db5d501c-6462-4b7c-956f-5dcda9fa995b-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[284de4a9-ad9a-4890-8d53-72e442518817]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:45 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD Sep 02 00:45:45 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-0526a124-bc5f-45ab-9300-e1c41b77eff0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:46 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 is fetched for user e4f95a4760434a3085e55e39f87ee9b5. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Lock "cinder-0526a124-bc5f-45ab-9300-e1c41b77eff0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-0526a124-bc5f-45ab-9300-e1c41b77eff0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-0526a124-bc5f-45ab-9300-e1c41b77eff0" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b6bf07-8a8b-441f-bb8f-a69367505a19]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a96aa4-ccdc-485f-93e8-914496b89aac]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:46 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 Sep 02 00:45:46 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:46 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD Sep 02 00:45:46 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:46 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0" returned: 0 in 0.580s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:47 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0 Sep 02 00:45:47 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:47 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1097508945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742984327fe14726bfe5876c7ac5c945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:45Z,use_quota=True,user_id='e4f95a4760434a3085e55e39f87ee9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Creating volume 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:45:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:47 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 1073741824 Sep 02 00:45:47 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:47 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0526a124-bc5f-45ab-9300-e1c41b77eff0" returned: 0 in 0.398s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-0526a124-bc5f-45ab-9300-e1c41b77eff0" released by "delete_volume" :: held 1.056s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Created reservations ['65fb9000-58a9-4779-9822-748ed33e4488', '49c34183-5a94-4de6-8703-380c153ca7be', 'b0a4174a-ac19-4447-88a3-a723b88ebb7b', '245f147a-d3ab-4f84-a9a7-b27c140ca033'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:47 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:45:47 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:47 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 1073741824" returned: 0 in 0.786s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:48 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 Sep 02 00:45:48 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:48 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.492s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:45:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Deleted volume successfully. Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb6f3529-17c9-49dc-ba2a-817c704ef91a tempest-VolumesGetTest-1014201995 None] Lock "cinder-0526a124-bc5f-45ab-9300-e1c41b77eff0-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:48 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0" returned: 0 in 0.376s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Attempting download of 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[82730b1a-e345-41f4-9dbd-7ac263ad2962]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_q6ha8p3g {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:48 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_q6ha8p3g Sep 02 00:45:48 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-70ac88b2-1b0f-4fb5-b81f-788874aca36e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Lock "cinder-70ac88b2-1b0f-4fb5-b81f-788874aca36e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-70ac88b2-1b0f-4fb5-b81f-788874aca36e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-70ac88b2-1b0f-4fb5-b81f-788874aca36e" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d0f04-73c6-476c-a54f-d5b81d4e8fb1]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:49 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e Sep 02 00:45:49 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:49 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_q6ha8p3g" returned: 0 in 0.735s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_q6ha8p3g {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:49 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_q6ha8p3g Sep 02 00:45:49 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:49 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e" returned: 0 in 0.537s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:49 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e Sep 02 00:45:49 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:49 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_q6ha8p3g" returned: 1 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_q6ha8p3g' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc700c3-c4a5-44e1-ab6e-e1b413d744ff]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:49 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-70ac88b2-1b0f-4fb5-b81f-788874aca36e" returned: 0 in 0.425s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:49 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD Sep 02 00:45:49 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-70ac88b2-1b0f-4fb5-b81f-788874aca36e" released by "delete_volume" :: held 1.089s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Created reservations ['c3538367-3b87-401a-9f49-1396471badca', '48dffe25-901d-4dcf-aad6-c4c06189e869', '01cf96fc-9a7f-476b-8607-ea6fa50626a6', 'd36283e5-81fe-4e77-9387-d625e7c74331'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:50 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:45:50 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:50 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD" returned: 0 in 0.518s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] 55fd1d9e-80e7-4ee4-bf99-467853787b78 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:50 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 Sep 02 00:45:50 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:50 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:45:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Deleted volume successfully. Sep 02 00:45:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-860dd149-fe5f-435d-b573-89057f466212 tempest-VolumesGetTest-1014201995 None] Lock "cinder-70ac88b2-1b0f-4fb5-b81f-788874aca36e-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (4d8a40be-4ff3-4303-8bc7-c91462d68879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bda0f6-ae7f-48fa-8cb2-3056b782a100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bda0f6-ae7f-48fa-8cb2-3056b782a100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-634825998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e891369f-430d-4293-970d-f8b9e49be69f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:52Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd27fc6b-07b4-45b3-b7d0-69d5bb29cb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd27fc6b-07b4-45b3-b7d0-69d5bb29cb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424185aa-d325-470f-92eb-e96e0f442a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:45:52 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0" returned: 0 in 2.685s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_wsbhinq4devstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:45:52 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Converted 112.00 MB image at 41.69 MB/s Sep 02 00:45:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:52 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 1G Sep 02 00:45:52 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424185aa-d325-470f-92eb-e96e0f442a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e891369f-430d-4293-970d-f8b9e49be69f', 'volume_name': 'volume-e891369f-430d-4293-970d-f8b9e49be69f', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9f5382-a510-48dc-9bdc-11b4fe799e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9f5382-a510-48dc-9bdc-11b4fe799e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74c26ea-8839-4334-8b1e-bcc154cba932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Volume e891369f-430d-4293-970d-f8b9e49be69f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e891369f-430d-4293-970d-f8b9e49be69f', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Trying to clone e891369f-430d-4293-970d-f8b9e49be69f from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:45:53 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 1G" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Downloaded image 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 for user e4f95a4760434a3085e55e39f87ee9b5 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Marking volume 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Copying metadata from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 to 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Creating volume glance metadata for volume 25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 backed by image 55fd1d9e-80e7-4ee4-bf99-467853787b78 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:45:53 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee0c967-2a2f-47c0-bf62-2d8121e10194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a0f60-ea2c-4da2-abce-559f682aa012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f1387-0497-4c95-b0d5-49fd070176e0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Volume volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 (25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0): created successfully Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a0f60-ea2c-4da2-abce-559f682aa012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:45:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Flow 'volume_create_manager' (292760a3-bedd-4928-badc-64bae6180106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:45:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-020ec862-8e07-4090-8c75-0bad0535eac9 tempest-ServerActionsTestOtherA-375885117 None] Created volume successfully. Sep 02 00:45:54 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD Sep 02 00:45:54 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:54 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:54 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 is fetched for user c981ee32848447aa97117ba0ad98fa48. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:45:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba75c220-dd61-4666-a83c-9caa4f71e566]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:55 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD Sep 02 00:45:55 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:55 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-634825998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e891369f-430d-4293-970d-f8b9e49be69f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:45:52Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Creating volume e891369f-430d-4293-970d-f8b9e49be69f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:45:55 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:45:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:55 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f 1073741824 Sep 02 00:45:55 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:56 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f 1073741824" returned: 0 in 0.865s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:56 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f Sep 02 00:45:56 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:56 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f" returned: 0 in 0.473s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:45:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:45:56 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Attempting download of 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume e891369f-430d-4293-970d-f8b9e49be69f. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:45:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c98ec3-16f8-4e4b-b7f6-fbf77359d027]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_vq5jnwa4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:57 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_vq5jnwa4 Sep 02 00:45:57 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:57 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_vq5jnwa4" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_vq5jnwa4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:57 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_vq5jnwa4 Sep 02 00:45:57 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:58 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_vq5jnwa4" returned: 1 in 0.747s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_vq5jnwa4' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:45:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae055b3-e90d-4331-8521-881046277b3f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:45:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:58 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD Sep 02 00:45:58 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:58 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 02 00:45:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD" returned: 0 in 0.638s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:45:58 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] 55fd1d9e-80e7-4ee4-bf99-467853787b78 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:45:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:45:59 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f Sep 02 00:45:59 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:45:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-bfa263f6-167c-433d-957e-a68d83b31cac req-534dfd28-c3f7-4d96-922e-d18184e411b5 tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:45:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-bfa263f6-167c-433d-957e-a68d83b31cac req-534dfd28-c3f7-4d96-922e-d18184e411b5 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-bfa263f6-167c-433d-957e-a68d83b31cac req-534dfd28-c3f7-4d96-922e-d18184e411b5 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-bfa263f6-167c-433d-957e-a68d83b31cac req-534dfd28-c3f7-4d96-922e-d18184e411b5 tempest-ServerActionsTestOtherA-375885117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29c5dc2c-f4b5-4dea-ba15-b006ed442c23', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:46:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-bfa263f6-167c-433d-957e-a68d83b31cac req-534dfd28-c3f7-4d96-922e-d18184e411b5 tempest-ServerActionsTestOtherA-375885117 None] attachment_update completed successfully. Sep 02 00:46:02 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f" returned: 0 in 3.163s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_lztuouvjdevstack@QuobyteHD, size 112.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:46:02 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Converted 112.00 MB image at 35.40 MB/s Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:02 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f 1G Sep 02 00:46:02 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:02 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f 1G" returned: 0 in 0.696s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Downloaded image 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume e891369f-430d-4293-970d-f8b9e49be69f successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 for user c981ee32848447aa97117ba0ad98fa48 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Marking volume e891369f-430d-4293-970d-f8b9e49be69f as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Copying metadata from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 to e891369f-430d-4293-970d-f8b9e49be69f. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:46:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Creating volume glance metadata for volume e891369f-430d-4293-970d-f8b9e49be69f backed by image 55fd1d9e-80e7-4ee4-bf99-467853787b78 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:46:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74c26ea-8839-4334-8b1e-bcc154cba932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e891369f-430d-4293-970d-f8b9e49be69f', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9af713-815e-4f7f-afea-fee3a8250bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Volume volume-e891369f-430d-4293-970d-f8b9e49be69f (e891369f-430d-4293-970d-f8b9e49be69f): created successfully Sep 02 00:46:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9af713-815e-4f7f-afea-fee3a8250bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (4d8a40be-4ff3-4303-8bc7-c91462d68879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-49ce7130-4ae5-4143-a730-44479589463f tempest-VolumesGetTest-1014201995 None] Created volume successfully. Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (e33caa3c-02d9-4569-a097-89f8f67001db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5280c0e7-d875-42cf-a51a-34c0a122477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5280c0e7-d875-42cf-a51a-34c0a122477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1764217591',display_name='tempest-VolumesGetTest-Volume-1208973405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f7fa9b-6f4f-472b-8eb6-bfae5641fc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:05Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d5bb47-5396-414a-8bbe-3b1bf12e7d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d5bb47-5396-414a-8bbe-3b1bf12e7d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ede278-4806-478c-bcf3-5c475448c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ede278-4806-478c-bcf3-5c475448c15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f7fa9b-6f4f-472b-8eb6-bfae5641fc64', 'volume_name': 'volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3001e38d-fea9-4083-9ab2-3419851dbead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3001e38d-fea9-4083-9ab2-3419851dbead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ad4ef6-8f49-42a6-a2da-0d56b1e4964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Volume 33f7fa9b-6f4f-472b-8eb6-bfae5641fc64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64', 'volume_size': 1} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1764217591',display_name='tempest-VolumesGetTest-Volume-1208973405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f7fa9b-6f4f-472b-8eb6-bfae5641fc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40a19bb6fed430e8dfc62ce9679e9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:05Z,use_quota=True,user_id='c981ee32848447aa97117ba0ad98fa48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Creating volume 33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:05 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:05 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 1073741824 Sep 02 00:46:05 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (19ff4b02-e6a5-420c-a65b-e59ccd61ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b769f8-d895-4a7e-99f5-6c61ef335670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b769f8-d895-4a7e-99f5-6c61ef335670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067862918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:06Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3982ae9-0d46-4e9c-a6b1-d980c7dad4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3982ae9-0d46-4e9c-a6b1-d980c7dad4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e47015-5ad3-41d3-8aa8-6b303058bad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e47015-5ad3-41d3-8aa8-6b303058bad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34', 'volume_name': 'volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817753a6-c678-416f-beec-13295f8ef222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817753a6-c678-416f-beec-13295f8ef222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:06 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bdbd1f-9aeb-4d4d-8c38-904bfcb9ba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Volume bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34', 'volume_size': 1} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 1073741824" returned: 0 in 1.098s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:06 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 Sep 02 00:46:06 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:07 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64" returned: 0 in 0.629s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067862918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:06Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Creating volume bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:07 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ad4ef6-8f49-42a6-a2da-0d56b1e4964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597a548f-8037-4b83-8db1-d8601dd8a2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:07 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 1073741824 Sep 02 00:46:07 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:07 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Volume volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 (33f7fa9b-6f4f-472b-8eb6-bfae5641fc64): created successfully Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597a548f-8037-4b83-8db1-d8601dd8a2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Flow 'volume_create_manager' (e33caa3c-02d9-4569-a097-89f8f67001db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3e245885-5f1e-47cf-ba60-91bc6ae75128 tempest-VolumesGetTest-1014201995 None] Created volume successfully. Sep 02 00:46:08 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 1073741824" returned: 0 in 0.984s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:08 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 Sep 02 00:46:08 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:08 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Lock "cinder-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bdbd1f-9aeb-4d4d-8c38-904bfcb9ba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006b5796-f239-4271-9505-0746894c2590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Volume volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 (bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34): created successfully Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006b5796-f239-4271-9505-0746894c2590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (19ff4b02-e6a5-420c-a65b-e59ccd61ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a4901bc3-02b0-49f4-a0cc-7579ac914284 tempest-VolumesActionsTest-1624428836 None] Created volume successfully. Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a885716a-93e1-4762-bdb6-91c710feaa8d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:09 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 Sep 02 00:46:09 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f53918f-f4dd-4c89-8ac6-ab7e9b75b50b tempest-VolumesActionsTest-1624428836 None] Acquiring lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" by "attach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f53918f-f4dd-4c89-8ac6-ab7e9b75b50b tempest-VolumesActionsTest-1624428836 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" acquired by "attach_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5f53918f-f4dd-4c89-8ac6-ab7e9b75b50b tempest-VolumesActionsTest-1624428836 None] Attaching volume bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 to instance 8590ce3f-790c-44b0-8472-4d3d750374ee at mountpoint /dev/vdb on host None. Sep 02 00:46:09 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64" returned: 0 in 0.791s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5f53918f-f4dd-4c89-8ac6-ab7e9b75b50b tempest-VolumesActionsTest-1624428836 None] Attach volume completed successfully. Sep 02 00:46:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f53918f-f4dd-4c89-8ac6-ab7e9b75b50b tempest-VolumesActionsTest-1624428836 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" released by "attach_volume" :: held 0.271s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:09 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64 Sep 02 00:46:09 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:10 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64" released by "delete_volume" :: held 1.256s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Created reservations ['ab487b6e-8b50-4571-860f-a44d4672927c', '0cf0d626-8654-405e-9489-bb4355a3ed41', 'd436e3d1-b823-4cef-9032-eaa07a72f4ff', 'edcd0194-1328-46ea-85a5-bfd5748534ff'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:10 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:10 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:10 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Deleted volume successfully. Sep 02 00:46:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d2ec464-ef82-4948-aa56-6a79f799ec2f tempest-VolumesActionsTest-154825489 None] Terminate volume connection completed successfully. Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db56df40-7c63-4edc-bfc1-6624debd1a75 tempest-VolumesGetTest-1014201995 None] Lock "cinder-33f7fa9b-6f4f-472b-8eb6-bfae5641fc64-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d2ec464-ef82-4948-aa56-6a79f799ec2f tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d2ec464-ef82-4948-aa56-6a79f799ec2f tempest-VolumesActionsTest-154825489 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d2ec464-ef82-4948-aa56-6a79f799ec2f tempest-VolumesActionsTest-154825489 None] Detaching volume bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 from instance 8590ce3f-790c-44b0-8472-4d3d750374ee. Sep 02 00:46:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d2ec464-ef82-4948-aa56-6a79f799ec2f tempest-VolumesActionsTest-154825489 None] Detach volume completed successfully. Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d2ec464-ef82-4948-aa56-6a79f799ec2f tempest-VolumesActionsTest-154825489 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-detach_volume" released by "detach_volume" :: held 0.164s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-e891369f-430d-4293-970d-f8b9e49be69f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Lock "cinder-e891369f-430d-4293-970d-f8b9e49be69f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Acquiring lock "cinder-quobyte-e891369f-430d-4293-970d-f8b9e49be69f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-e891369f-430d-4293-970d-f8b9e49be69f" acquired by "delete_volume" :: waited 0.049s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3409cee7-542a-4fa8-bfb7-e6fc951726ba tempest-VolumesActionsTest-1624428836 None] Acquiring lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcae1c03-4dee-4a59-9ffa-8d2774c5c30f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3409cee7-542a-4fa8-bfb7-e6fc951726ba tempest-VolumesActionsTest-1624428836 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-detach_volume" acquired by "detach_volume" :: waited 0.070s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3409cee7-542a-4fa8-bfb7-e6fc951726ba tempest-VolumesActionsTest-1624428836 None] Volume detach called, but volume not attached. Sep 02 00:46:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3409cee7-542a-4fa8-bfb7-e6fc951726ba tempest-VolumesActionsTest-1624428836 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:11 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f Sep 02 00:46:11 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:12 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:12 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "cinder-quobyte-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:12 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.525s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-quobyte-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[633a1285-1105-4026-b03b-883777b684e8]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:12 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f" returned: 0 in 1.150s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:12 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 Sep 02 00:46:12 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:12 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f Sep 02 00:46:12 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:13 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e891369f-430d-4293-970d-f8b9e49be69f" returned: 0 in 0.506s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Lock "cinder-quobyte-e891369f-430d-4293-970d-f8b9e49be69f" released by "delete_volume" :: held 1.752s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=82,cinder:UPDATE=91,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:46:13 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" returned: 0 in 0.736s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:13 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34 Sep 02 00:46:13 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Created reservations ['bf082444-f681-4299-a27b-7f6a64db5423', 'ee72eb6a-0b38-4bc0-b4dd-1e194556662d', '91d187c0-1570-4b82-91de-827215356b63', '4727d181-71b8-47c1-9374-1615855ad042'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:13 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:13 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:14 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" returned: 0 in 0.617s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-quobyte-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34" released by "delete_volume" :: held 1.457s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=91,cinder:UPDATE=89,cinder:INSERT=37,cinder:DELETE=8 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Created reservations ['787571c6-5698-4030-8ffc-cc9ad59d5715', '21c95876-5509-4992-9f73-5564ef056e3a', '6810959f-2a07-45e3-958a-ecf5df141514', 'b562ff69-543c-4ee3-9889-45ceb010beea'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:14 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.580s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Deleted volume successfully. Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f037388-7f07-4549-b6e3-d6f92a77e9ba tempest-VolumesGetTest-1014201995 None] Lock "cinder-e891369f-430d-4293-970d-f8b9e49be69f-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:14 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:14 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:15 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.947s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Deleted volume successfully. Sep 02 00:46:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-772db7eb-4efa-4236-8143-52643ee886a3 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-bf550bcc-e001-4bdc-a99f-9f7d9fd3fe34-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Flow 'volume_create_manager' (e0b5b074-72bc-4558-8508-3ff7df224aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7056811-c08f-4f63-9856-8f759988521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7056811-c08f-4f63-9856-8f759988521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-892614141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9107adc4-4b7d-4350-bd33-3a2068a29d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3fd98f690b42e18a4986a967666ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:21Z,use_quota=True,user_id='05fa3be3da324cefb116d008e439afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d91663-7041-40b3-b426-264865cf0945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d91663-7041-40b3-b426-264865cf0945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0c167d-8ab3-40d1-b518-ffba3563feb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0c167d-8ab3-40d1-b518-ffba3563feb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9107adc4-4b7d-4350-bd33-3a2068a29d62', 'volume_name': 'volume-9107adc4-4b7d-4350-bd33-3a2068a29d62', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6e30a6-186d-41ff-8ed4-484b8488ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6e30a6-186d-41ff-8ed4-484b8488ee50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14416fe4-6711-4da5-8a81-ac0406a41f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Volume 9107adc4-4b7d-4350-bd33-3a2068a29d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9107adc4-4b7d-4350-bd33-3a2068a29d62', 'volume_size': 1} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-892614141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9107adc4-4b7d-4350-bd33-3a2068a29d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3fd98f690b42e18a4986a967666ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:21Z,use_quota=True,user_id='05fa3be3da324cefb116d008e439afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Creating volume 9107adc4-4b7d-4350-bd33-3a2068a29d62 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:21 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:21 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 1073741824 Sep 02 00:46:21 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:22 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 1073741824" returned: 0 in 0.832s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:22 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 Sep 02 00:46:22 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (0959cfd0-acca-45e4-84e3-0c9d95c03e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48cb06d-5f70-4ec9-9b9a-8b0319632b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48cb06d-5f70-4ec9-9b9a-8b0319632b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627760842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172657e-184d-42f8-8281-24ec7d78804d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:22Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd654fcd-31c3-4fdd-8577-273e9bdfe591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd654fcd-31c3-4fdd-8577-273e9bdfe591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33641c18-fc69-481b-97a8-7da85d5a57e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33641c18-fc69-481b-97a8-7da85d5a57e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3172657e-184d-42f8-8281-24ec7d78804d', 'volume_name': 'volume-3172657e-184d-42f8-8281-24ec7d78804d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a410ea-7393-4b02-a662-1862cb103b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a410ea-7393-4b02-a662-1862cb103b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf5b205-c75a-4e7a-b314-d7ad07ceb987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Volume 3172657e-184d-42f8-8281-24ec7d78804d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3172657e-184d-42f8-8281-24ec7d78804d', 'volume_size': 1} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Flow 'volume_create_manager' (490dc7ad-1ea5-4cef-901b-f95d02e9f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b4770f-8a04-4ac5-bfd9-3b271701dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b4770f-8a04-4ac5-bfd9-3b271701dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-957385682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab513925-e364-4b2f-9b7d-eac464c3c46f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bba0bd145f48ea9ee24d75c4b15869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:22Z,use_quota=True,user_id='1a6b0e0b265e4c60a55eaab28bd81e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb86ad5-1964-4b78-ae50-2b124b3a2c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb86ad5-1964-4b78-ae50-2b124b3a2c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785f5606-e7ca-4ad1-9eab-b7330f7fad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785f5606-e7ca-4ad1-9eab-b7330f7fad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab513925-e364-4b2f-9b7d-eac464c3c46f', 'volume_name': 'volume-ab513925-e364-4b2f-9b7d-eac464c3c46f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcecc80-b89e-46ce-9a4a-bb2b3d136ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcecc80-b89e-46ce-9a4a-bb2b3d136ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016eaebe-e0e4-4102-af2c-49c576e78283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Volume ab513925-e364-4b2f-9b7d-eac464c3c46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab513925-e364-4b2f-9b7d-eac464c3c46f', 'volume_size': 1} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62" returned: 0 in 0.327s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-627760842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172657e-184d-42f8-8281-24ec7d78804d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:22Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Creating volume 3172657e-184d-42f8-8281-24ec7d78804d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:22 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14416fe4-6711-4da5-8a81-ac0406a41f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9107adc4-4b7d-4350-bd33-3a2068a29d62', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d 1073741824 Sep 02 00:46:22 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017a53fa-2fbb-44fb-b351-451c6409dbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Volume volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 (9107adc4-4b7d-4350-bd33-3a2068a29d62): created successfully Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017a53fa-2fbb-44fb-b351-451c6409dbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Flow 'volume_create_manager' (e0b5b074-72bc-4558-8508-3ff7df224aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-46df3019-687d-4328-992d-c57d5adb283a tempest-AttachVolumeNegativeTest-298902001 None] Created volume successfully. Sep 02 00:46:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-367e6cfd-0df1-4179-b11e-6360fdd3e741 req-87cb3058-aa4b-448e-899b-123c8e8567bc tempest-ServerActionsTestOtherA-375885117 None] Terminate volume connection completed successfully. Sep 02 00:46:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-367e6cfd-0df1-4179-b11e-6360fdd3e741 req-87cb3058-aa4b-448e-899b-123c8e8567bc tempest-ServerActionsTestOtherA-375885117 None] Deleting attachment 29c5dc2c-f4b5-4dea-ba15-b006ed442c23. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:46:23 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d 1073741824" returned: 0 in 0.661s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:23 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d Sep 02 00:46:23 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:23 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-957385682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab513925-e364-4b2f-9b7d-eac464c3c46f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bba0bd145f48ea9ee24d75c4b15869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:22Z,use_quota=True,user_id='1a6b0e0b265e4c60a55eaab28bd81e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Creating volume ab513925-e364-4b2f-9b7d-eac464c3c46f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf5b205-c75a-4e7a-b314-d7ad07ceb987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3172657e-184d-42f8-8281-24ec7d78804d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:23 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f 1073741824 Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf92c81e-44d2-4e77-adb1-d54e823b5ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:23 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Volume volume-3172657e-184d-42f8-8281-24ec7d78804d (3172657e-184d-42f8-8281-24ec7d78804d): created successfully Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf92c81e-44d2-4e77-adb1-d54e823b5ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (0959cfd0-acca-45e4-84e3-0c9d95c03e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b460be52-ccb6-4d27-9c7f-a43203cc7547 tempest-VolumesActionsTest-1624428836 None] Created volume successfully. Sep 02 00:46:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-cd5e8855-181f-4f1d-ba07-d50c20ecd2ff req-bedbe191-9db6-4aac-8ae0-551cd9095dcb tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:24 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f 1073741824" returned: 0 in 0.563s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:24 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f Sep 02 00:46:24 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:24 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-cd5e8855-181f-4f1d-ba07-d50c20ecd2ff req-bedbe191-9db6-4aac-8ae0-551cd9095dcb tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.474s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-3172657e-184d-42f8-8281-24ec7d78804d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-cd5e8855-181f-4f1d-ba07-d50c20ecd2ff req-bedbe191-9db6-4aac-8ae0-551cd9095dcb tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016eaebe-e0e4-4102-af2c-49c576e78283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab513925-e364-4b2f-9b7d-eac464c3c46f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c13cd96-681b-4518-960b-c37447c88fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Lock "cinder-3172657e-184d-42f8-8281-24ec7d78804d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Volume volume-ab513925-e364-4b2f-9b7d-eac464c3c46f (ab513925-e364-4b2f-9b7d-eac464c3c46f): created successfully Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c13cd96-681b-4518-960b-c37447c88fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Flow 'volume_create_manager' (490dc7ad-1ea5-4cef-901b-f95d02e9f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bfe3c06c-9580-449b-b8d2-0a86ec4dd17b tempest-VolumesListTestJSON-123699473 None] Created volume successfully. Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-cd5e8855-181f-4f1d-ba07-d50c20ecd2ff req-bedbe191-9db6-4aac-8ae0-551cd9095dcb tempest-AttachVolumeNegativeTest-298902001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-9107adc4-4b7d-4350-bd33-3a2068a29d62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84ffa433-4ae2-4863-bafb-793f869208d5', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-quobyte-3172657e-184d-42f8-8281-24ec7d78804d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-3172657e-184d-42f8-8281-24ec7d78804d" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d400a11-a5d4-42ae-b8cf-8ec7a172e7ef]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-cd5e8855-181f-4f1d-ba07-d50c20ecd2ff req-bedbe191-9db6-4aac-8ae0-551cd9095dcb tempest-AttachVolumeNegativeTest-298902001 None] attachment_update completed successfully. Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-367e6cfd-0df1-4179-b11e-6360fdd3e741 req-a4814524-e708-4710-9825-f13091392265 tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-367e6cfd-0df1-4179-b11e-6360fdd3e741 req-a4814524-e708-4710-9825-f13091392265 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-367e6cfd-0df1-4179-b11e-6360fdd3e741 req-a4814524-e708-4710-9825-f13091392265 tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-367e6cfd-0df1-4179-b11e-6360fdd3e741 req-a4814524-e708-4710-9825-f13091392265 tempest-ServerActionsTestOtherA-375885117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eaaae9d0-5b9c-4194-b5f2-997c69e7e893', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:46:24 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d Sep 02 00:46:24 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-367e6cfd-0df1-4179-b11e-6360fdd3e741 req-a4814524-e708-4710-9825-f13091392265 tempest-ServerActionsTestOtherA-375885117 None] attachment_update completed successfully. Sep 02 00:46:25 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d" returned: 0 in 0.501s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:25 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d Sep 02 00:46:25 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:25 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3172657e-184d-42f8-8281-24ec7d78804d" returned: 0 in 0.669s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-3172657e-184d-42f8-8281-24ec7d78804d" released by "delete_volume" :: held 1.255s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:25 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Created reservations ['7985b018-5286-471a-a5c5-25d1a502d0f0', '3ae953fb-d844-4e9a-b0e7-b9bd9e3e147e', '1a4afef5-03c0-40e7-a071-a21405713303', '8d85004e-f4d4-4ac4-9a8e-3fdefb14a41d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:26 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:26 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:26 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.595s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Deleted volume successfully. Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Flow 'volume_create_manager' (5614403d-4b4a-4848-8ad2-a1e8db672ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc0364c-3846-411b-8ba3-170fddfcabd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc0364c-3846-411b-8ba3-170fddfcabd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-501261230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223b2a41-54c7-4d38-95fa-6ac35c62bd6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bba0bd145f48ea9ee24d75c4b15869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:27Z,use_quota=True,user_id='1a6b0e0b265e4c60a55eaab28bd81e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282dea1a-06c2-414b-b5ed-b458b02668f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282dea1a-06c2-414b-b5ed-b458b02668f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fcd9e5-8181-4679-937e-3811c1b76e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fcd9e5-8181-4679-937e-3811c1b76e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223b2a41-54c7-4d38-95fa-6ac35c62bd6c', 'volume_name': 'volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cde057-c298-44c5-bc2d-f5719d080216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cde057-c298-44c5-bc2d-f5719d080216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa581f-2fe2-4a31-bbf3-9e48aa05130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Volume 223b2a41-54c7-4d38-95fa-6ac35c62bd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c', 'volume_size': 1} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-501261230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223b2a41-54c7-4d38-95fa-6ac35c62bd6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bba0bd145f48ea9ee24d75c4b15869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:27Z,use_quota=True,user_id='1a6b0e0b265e4c60a55eaab28bd81e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Creating volume 223b2a41-54c7-4d38-95fa-6ac35c62bd6c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:26 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6356e900-a6cf-4830-8c5c-6821172a6622 tempest-VolumesActionsTest-154825489 None] Lock "cinder-3172657e-184d-42f8-8281-24ec7d78804d-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:26 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c 1073741824 Sep 02 00:46:26 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:27 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c 1073741824" returned: 0 in 0.966s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (45140ad1-d8b0-4a53-bc03-2d2f00398a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a92e2d4-8462-4194-8b54-d5d687114360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a92e2d4-8462-4194-8b54-d5d687114360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155221864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7111bc-62bd-479a-a1e5-75fecc5cec3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:28Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a086c7e9-4dec-483a-ab81-cb0d77b63395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a086c7e9-4dec-483a-ab81-cb0d77b63395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a847d4d-e573-40ad-9fa1-e311bd98d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a847d4d-e573-40ad-9fa1-e311bd98d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7111bc-62bd-479a-a1e5-75fecc5cec3f', 'volume_name': 'volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5fab4b-54bc-4feb-9168-dae2347b4653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5fab4b-54bc-4feb-9168-dae2347b4653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4bc75-886d-4228-beb8-2e8a808f1962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Volume fb7111bc-62bd-479a-a1e5-75fecc5cec3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f', 'volume_size': 1} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-dbde16d2-f139-40df-b917-932a6cd14524 req-52f36f3a-9390-488a-bf56-7f7df635f0a8 tempest-AttachVolumeNegativeTest-298902001 None] Terminate volume connection completed successfully. Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-dbde16d2-f139-40df-b917-932a6cd14524 req-52f36f3a-9390-488a-bf56-7f7df635f0a8 tempest-AttachVolumeNegativeTest-298902001 None] Deleting attachment 84ffa433-4ae2-4863-bafb-793f869208d5. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:46:28 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c Sep 02 00:46:28 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:28 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155221864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7111bc-62bd-479a-a1e5-75fecc5cec3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:28Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Creating volume fb7111bc-62bd-479a-a1e5-75fecc5cec3f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:28 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa581f-2fe2-4a31-bbf3-9e48aa05130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:28 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f 1073741824 Sep 02 00:46:28 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bfe2fd-62de-450d-b73a-b0705ec8e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Volume volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c (223b2a41-54c7-4d38-95fa-6ac35c62bd6c): created successfully Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bfe2fd-62de-450d-b73a-b0705ec8e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Flow 'volume_create_manager' (5614403d-4b4a-4848-8ad2-a1e8db672ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f0689936-bf63-428d-97bd-fe3381afc468 tempest-VolumesListTestJSON-123699473 None] Created volume successfully. Sep 02 00:46:28 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f 1073741824" returned: 0 in 0.557s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:29 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f Sep 02 00:46:29 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:29 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f" returned: 0 in 0.718s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Flow 'volume_create_manager' (ffd65df6-94d6-43f3-886b-379cd8db03a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b8b9d-17a6-4f86-923c-acf0551f010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4bc75-886d-4228-beb8-2e8a808f1962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0ed73c-d8aa-4644-bb43-1ce5561033ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b8b9d-17a6-4f86-923c-acf0551f010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-533270214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c39a0f-e74f-4e3a-8e14-192471100454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bba0bd145f48ea9ee24d75c4b15869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:30Z,use_quota=True,user_id='1a6b0e0b265e4c60a55eaab28bd81e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d995b3-5b2e-4789-97bf-125639a05ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d995b3-5b2e-4789-97bf-125639a05ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee60fb7-eea7-4bb1-97d1-498c1297700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee60fb7-eea7-4bb1-97d1-498c1297700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c39a0f-e74f-4e3a-8e14-192471100454', 'volume_name': 'volume-36c39a0f-e74f-4e3a-8e14-192471100454', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdb8369-8b8a-4bc7-a9e1-5f2522670355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdb8369-8b8a-4bc7-a9e1-5f2522670355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fb40e-2e92-40e5-976a-0d97c65e392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Volume 36c39a0f-e74f-4e3a-8e14-192471100454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c39a0f-e74f-4e3a-8e14-192471100454', 'volume_size': 1} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-533270214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c39a0f-e74f-4e3a-8e14-192471100454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4bba0bd145f48ea9ee24d75c4b15869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:30Z,use_quota=True,user_id='1a6b0e0b265e4c60a55eaab28bd81e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Creating volume 36c39a0f-e74f-4e3a-8e14-192471100454 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Volume volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f (fb7111bc-62bd-479a-a1e5-75fecc5cec3f): created successfully Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0ed73c-d8aa-4644-bb43-1ce5561033ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (45140ad1-d8b0-4a53-bc03-2d2f00398a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:30 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 1073741824 Sep 02 00:46:30 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8dff3f74-e056-4da1-9eb1-a8cd30b64480 tempest-VolumesActionsTest-1624428836 None] Created volume successfully. Sep 02 00:46:30 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 1073741824" returned: 0 in 0.930s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:31 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 Sep 02 00:46:31 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:31 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-fb7111bc-62bd-479a-a1e5-75fecc5cec3f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454" returned: 0 in 0.431s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fb40e-2e92-40e5-976a-0d97c65e392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c39a0f-e74f-4e3a-8e14-192471100454', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8104864a-1160-43c7-85c8-3a8cb3c4a304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Lock "cinder-fb7111bc-62bd-479a-a1e5-75fecc5cec3f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Volume volume-36c39a0f-e74f-4e3a-8e14-192471100454 (36c39a0f-e74f-4e3a-8e14-192471100454): created successfully Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8104864a-1160-43c7-85c8-3a8cb3c4a304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Flow 'volume_create_manager' (ffd65df6-94d6-43f3-886b-379cd8db03a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7602f09a-341c-4554-b912-df453dc01fd9 tempest-VolumesListTestJSON-123699473 None] Created volume successfully. Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-quobyte-fb7111bc-62bd-479a-a1e5-75fecc5cec3f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-fb7111bc-62bd-479a-a1e5-75fecc5cec3f" acquired by "delete_volume" :: waited 0.049s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a96ff3c-b7f0-4f00-aeae-b68bc4999570]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:31 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f Sep 02 00:46:31 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:32 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f" returned: 0 in 0.840s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:32 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f Sep 02 00:46:32 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:33 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fb7111bc-62bd-479a-a1e5-75fecc5cec3f" returned: 0 in 0.672s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-fb7111bc-62bd-479a-a1e5-75fecc5cec3f" released by "delete_volume" :: held 1.576s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Created reservations ['9a31d9a4-0efc-4478-a0a1-afcf7101caed', '38cdd9d5-0b99-4534-a898-fda2df1cc342', '352f6a79-2627-4a61-8b86-81db04c67654', '54c8399c-f9f6-4d81-8da0-9c186e8f688e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:33 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:33 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:33 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.468s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:33 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Deleted volume successfully. Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e56bf03-d7b0-424e-90c0-a3b7ba06b9d0 tempest-VolumesActionsTest-154825489 None] Lock "cinder-fb7111bc-62bd-479a-a1e5-75fecc5cec3f-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (bad3ab40-da64-4e3c-be9c-f470662e1588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec870b4-c10e-4702-bc50-e9b21627f15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec870b4-c10e-4702-bc50-e9b21627f15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694929018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f460b94f-04d1-4811-8d07-3488add620d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:35Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c86ad77-fcd2-4046-9646-2f7e58b1b697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c86ad77-fcd2-4046-9646-2f7e58b1b697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7833b53-96cf-4923-a4c1-9f9cc227620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7833b53-96cf-4923-a4c1-9f9cc227620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f460b94f-04d1-4811-8d07-3488add620d6', 'volume_name': 'volume-f460b94f-04d1-4811-8d07-3488add620d6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb9ca81-6847-43e4-a370-8b0ea1fe438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb9ca81-6847-43e4-a370-8b0ea1fe438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14af7322-4962-469b-954d-2ccb83fa1505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Volume f460b94f-04d1-4811-8d07-3488add620d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f460b94f-04d1-4811-8d07-3488add620d6', 'volume_size': 1} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-694929018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f460b94f-04d1-4811-8d07-3488add620d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:35Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Creating volume f460b94f-04d1-4811-8d07-3488add620d6 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:35 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:35 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 1073741824 Sep 02 00:46:35 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:35 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 1073741824" returned: 0 in 0.634s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:35 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 Sep 02 00:46:35 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:36 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "cinder-36c39a0f-e74f-4e3a-8e14-192471100454-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6" returned: 0 in 0.362s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-36c39a0f-e74f-4e3a-8e14-192471100454-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14af7322-4962-469b-954d-2ccb83fa1505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f460b94f-04d1-4811-8d07-3488add620d6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f8a50c-6ce9-420d-abfd-fc4bebe03ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Volume volume-f460b94f-04d1-4811-8d07-3488add620d6 (f460b94f-04d1-4811-8d07-3488add620d6): created successfully Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f8a50c-6ce9-420d-abfd-fc4bebe03ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (bad3ab40-da64-4e3c-be9c-f470662e1588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5c463231-b813-4e19-be13-3bc128f79d55 tempest-VolumesActionsTest-1624428836 None] Created volume successfully. Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "cinder-quobyte-36c39a0f-e74f-4e3a-8e14-192471100454" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-quobyte-36c39a0f-e74f-4e3a-8e14-192471100454" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf65917-01f9-495d-a52e-4c2ebf0548c9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:36 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 Sep 02 00:46:36 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:36 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:36 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454 Sep 02 00:46:36 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:36 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-36c39a0f-e74f-4e3a-8e14-192471100454" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-quobyte-36c39a0f-e74f-4e3a-8e14-192471100454" released by "delete_volume" :: held 0.720s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Created reservations ['bd9e1504-1a37-47e4-b9ea-a0d43f86a35a', '2fac52bb-223a-411a-acd3-4e0917b73ea7', '9eb6d75b-2095-4025-8529-67e4cb1849ef', '1a45566d-bf89-45e0-af7b-5f8f43532e21'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-f460b94f-04d1-4811-8d07-3488add620d6-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:37 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:37 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Lock "cinder-f460b94f-04d1-4811-8d07-3488add620d6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-quobyte-f460b94f-04d1-4811-8d07-3488add620d6" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-f460b94f-04d1-4811-8d07-3488add620d6" acquired by "delete_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec09b6a-c9c6-48b0-b60c-b3f9f19fb254]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Acquiring lock "cinder-223b2a41-54c7-4d38-95fa-6ac35c62bd6c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Lock "cinder-223b2a41-54c7-4d38-95fa-6ac35c62bd6c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:37 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.482s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Deleted volume successfully. Sep 02 00:46:37 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 Sep 02 00:46:37 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Acquiring lock "cinder-quobyte-223b2a41-54c7-4d38-95fa-6ac35c62bd6c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-82fe1240-507f-4ab2-8169-8316ff83df08 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-36c39a0f-e74f-4e3a-8e14-192471100454-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Lock "cinder-quobyte-223b2a41-54c7-4d38-95fa-6ac35c62bd6c" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b7ce1e-8bc7-4ca9-b5d9-b011003eb1f0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:37 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c Sep 02 00:46:37 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:38 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6" returned: 0 in 0.657s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:38 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6 Sep 02 00:46:38 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:38 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c" returned: 0 in 0.502s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:38 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c Sep 02 00:46:38 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:38 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f460b94f-04d1-4811-8d07-3488add620d6" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-f460b94f-04d1-4811-8d07-3488add620d6" released by "delete_volume" :: held 1.082s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Created reservations ['e05f2f35-a7c6-4e06-9ffc-025f7de4809a', 'e9249fee-4ad7-4c52-b944-13e73db16f0b', '2f7aca21-af6f-468c-b64c-50842e241e65', '805a85b1-65bc-4f58-a47e-257dbe018dce'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:38 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-223b2a41-54c7-4d38-95fa-6ac35c62bd6c" returned: 0 in 0.329s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Lock "cinder-quobyte-223b2a41-54c7-4d38-95fa-6ac35c62bd6c" released by "delete_volume" :: held 0.887s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:38 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:38 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Created reservations ['ab1631be-f2e8-4909-8827-d7b4ad05c631', 'ecae2ee5-6996-410b-8df1-59f717913f8e', '269350c2-6f13-4197-9e0b-7c7c2ebe2903', '650a0f58-0fe7-43c7-b41a-bfed0cbfff60'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:38 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:38 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:39 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:39 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Deleted volume successfully. Sep 02 00:46:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4800ff8b-1faf-4a9d-9b5e-4e454bf3a604 tempest-VolumesActionsTest-154825489 None] Lock "cinder-f460b94f-04d1-4811-8d07-3488add620d6-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:39 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:39 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Deleted volume successfully. Sep 02 00:46:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afef9268-066e-4411-a58f-2563666df91c tempest-VolumesListTestJSON-123699473 None] Lock "cinder-223b2a41-54c7-4d38-95fa-6ac35c62bd6c-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "cinder-ab513925-e364-4b2f-9b7d-eac464c3c46f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-ab513925-e364-4b2f-9b7d-eac464c3c46f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "cinder-quobyte-ab513925-e364-4b2f-9b7d-eac464c3c46f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-quobyte-ab513925-e364-4b2f-9b7d-eac464c3c46f" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7fb925-3bd6-4c50-9b4d-f2fca7dc6519]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:40 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f Sep 02 00:46:40 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (b6fcd6d5-6d96-480c-bb58-8de169bead7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63976470-6e3c-47d0-aec4-6e399ee0de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63976470-6e3c-47d0-aec4-6e399ee0de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419530937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4234bf76-d5fb-4be2-b0f6-07184dcb8784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:40Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e282a4-098d-4a59-9dd9-ccf850678c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e282a4-098d-4a59-9dd9-ccf850678c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c01dd4-8e74-4827-9558-75606f16001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c01dd4-8e74-4827-9558-75606f16001b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4234bf76-d5fb-4be2-b0f6-07184dcb8784', 'volume_name': 'volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787f90d0-4b77-4b3b-9125-05062c6496ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787f90d0-4b77-4b3b-9125-05062c6496ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130a3807-8f29-4b12-9c85-b72572abce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Volume 4234bf76-d5fb-4be2-b0f6-07184dcb8784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784', 'volume_size': 1} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419530937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4234bf76-d5fb-4be2-b0f6-07184dcb8784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:40Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Creating volume 4234bf76-d5fb-4be2-b0f6-07184dcb8784 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:40 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 1073741824 Sep 02 00:46:40 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:40 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:40 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f Sep 02 00:46:40 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:41 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 1073741824" returned: 0 in 0.683s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:41 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ab513925-e364-4b2f-9b7d-eac464c3c46f" returned: 0 in 0.458s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-quobyte-ab513925-e364-4b2f-9b7d-eac464c3c46f" released by "delete_volume" :: held 1.107s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:41 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 Sep 02 00:46:41 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Created reservations ['efd2c445-4719-478b-9a44-3d7e0429f352', 'd562b263-186f-4cde-b26f-94643aecd9fb', 'cc30d541-2b45-4023-9a2b-9f2f5dcdf140', '76a08652-f436-4b82-bf83-bd542d8092d5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:41 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:41 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:41 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130a3807-8f29-4b12-9c85-b72572abce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5b56a7-15fb-4560-84e6-85d23fd1e30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Volume volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 (4234bf76-d5fb-4be2-b0f6-07184dcb8784): created successfully Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5b56a7-15fb-4560-84e6-85d23fd1e30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (b6fcd6d5-6d96-480c-bb58-8de169bead7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7536b4d2-c190-48db-b6a8-530cba80cefa tempest-VolumesActionsTest-1624428836 None] Created volume successfully. Sep 02 00:46:41 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Deleted volume successfully. Sep 02 00:46:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-654a166d-5a52-4b11-b051-44e6bdedcc54 tempest-VolumesListTestJSON-123699473 None] Lock "cinder-ab513925-e364-4b2f-9b7d-eac464c3c46f-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-4234bf76-d5fb-4be2-b0f6-07184dcb8784-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Lock "cinder-4234bf76-d5fb-4be2-b0f6-07184dcb8784-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Acquiring lock "cinder-quobyte-4234bf76-d5fb-4be2-b0f6-07184dcb8784" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-4234bf76-d5fb-4be2-b0f6-07184dcb8784" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[135810c3-24d7-4e59-8f94-816dadd2b397]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:43 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 Sep 02 00:46:43 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:43 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784" returned: 0 in 0.529s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:43 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784 Sep 02 00:46:43 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:43 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4234bf76-d5fb-4be2-b0f6-07184dcb8784" returned: 0 in 0.506s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Lock "cinder-quobyte-4234bf76-d5fb-4be2-b0f6-07184dcb8784" released by "delete_volume" :: held 1.104s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:43 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Created reservations ['6cabdfab-1ca9-4086-bdee-9f80a978dcd4', 'e4c67879-c11c-4e89-acef-b5ef510b59ef', '528ff7e9-3eba-40d0-8b54-bd3b9a27b9f3', '792a49a5-063c-4ced-88fd-8f061385c255'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:44 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:44 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:44 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Deleted volume successfully. Sep 02 00:46:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3698ea7d-1aae-4405-8f53-6d9b56060a5c tempest-VolumesActionsTest-154825489 None] Lock "cinder-4234bf76-d5fb-4be2-b0f6-07184dcb8784-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (79f6e41a-f735-43cc-94bb-bd430b3c5974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ffb7cb-9445-46b4-8f5b-32ed0cbcc49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ffb7cb-9445-46b4-8f5b-32ed0cbcc49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208733693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844d5e3f-6c71-401c-9d19-213951db23fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:46Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d53ab03-ffa6-4bc8-842e-ca2827d06802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d53ab03-ffa6-4bc8-842e-ca2827d06802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4268fa2-6073-48c1-891e-a7a5664c409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4268fa2-6073-48c1-891e-a7a5664c409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844d5e3f-6c71-401c-9d19-213951db23fe', 'volume_name': 'volume-844d5e3f-6c71-401c-9d19-213951db23fe', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f477e8-4fae-451d-a7e1-787d0c7d82f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f477e8-4fae-451d-a7e1-787d0c7d82f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79425426-85e1-4de1-be86-2e496e498472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Volume 844d5e3f-6c71-401c-9d19-213951db23fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844d5e3f-6c71-401c-9d19-213951db23fe', 'volume_size': 1} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208733693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844d5e3f-6c71-401c-9d19-213951db23fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b335fdf0dce465880bc78770aca5684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:46Z,use_quota=True,user_id='a3429ff61ad642c0a19293756d20a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Creating volume 844d5e3f-6c71-401c-9d19-213951db23fe {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:46 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:46 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe 1073741824 Sep 02 00:46:46 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:47 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe 1073741824" returned: 0 in 1.099s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:47 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe Sep 02 00:46:47 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:47 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Flow 'volume_create_manager' (309d13a6-cab7-46bf-81b7-5bc2ae0eb74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b895f-a895-4462-98de-0effeeb3b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe" returned: 0 in 0.540s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b895f-a895-4462-98de-0effeeb3b34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1763837421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfde9809-2c01-4d3c-866d-bfc909adff5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac41849554d4375b6e8439c9b5e67ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:48Z,use_quota=True,user_id='dee92907cfc046ab971c6cf22bd40c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e0f047-a934-4d7d-9fc4-55778accf876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e0f047-a934-4d7d-9fc4-55778accf876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c75d59-fa83-4eb4-8173-11412abb4ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c75d59-fa83-4eb4-8173-11412abb4ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfde9809-2c01-4d3c-866d-bfc909adff5f', 'volume_name': 'volume-dfde9809-2c01-4d3c-866d-bfc909adff5f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e197fee-16c8-4901-b11b-778112a2df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e197fee-16c8-4901-b11b-778112a2df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dda385e-91f1-46a4-b9ae-b2cb0a0211ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Volume dfde9809-2c01-4d3c-866d-bfc909adff5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfde9809-2c01-4d3c-866d-bfc909adff5f', 'volume_size': 1} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1763837421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfde9809-2c01-4d3c-866d-bfc909adff5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac41849554d4375b6e8439c9b5e67ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:46:48Z,use_quota=True,user_id='dee92907cfc046ab971c6cf22bd40c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Creating volume dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:46:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79425426-85e1-4de1-be86-2e496e498472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844d5e3f-6c71-401c-9d19-213951db23fe', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648a0d60-5b79-4e90-a0d8-f5521fd26b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:47 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f 1073741824 Sep 02 00:46:47 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Volume volume-844d5e3f-6c71-401c-9d19-213951db23fe (844d5e3f-6c71-401c-9d19-213951db23fe): created successfully Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648a0d60-5b79-4e90-a0d8-f5521fd26b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Flow 'volume_create_manager' (79f6e41a-f735-43cc-94bb-bd430b3c5974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-82441660-d9e0-4f3c-90a6-2ac9a436aa37 tempest-VolumesActionsTest-1624428836 None] Created volume successfully. Sep 02 00:46:48 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f 1073741824" returned: 0 in 0.710s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:48 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f Sep 02 00:46:48 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:48 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dda385e-91f1-46a4-b9ae-b2cb0a0211ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfde9809-2c01-4d3c-866d-bfc909adff5f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e785237-2e39-4197-87b3-e0e0d023ee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:46:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Volume volume-dfde9809-2c01-4d3c-866d-bfc909adff5f (dfde9809-2c01-4d3c-866d-bfc909adff5f): created successfully Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e785237-2e39-4197-87b3-e0e0d023ee1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:46:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Flow 'volume_create_manager' (309d13a6-cab7-46bf-81b7-5bc2ae0eb74d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:46:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3723878a-2071-4709-82de-153b1f4d3b0b tempest-VolumesSnapshotListTestJSON-706223526 None] Created volume successfully. Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "cinder-844d5e3f-6c71-401c-9d19-213951db23fe-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-844d5e3f-6c71-401c-9d19-213951db23fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "cinder-quobyte-844d5e3f-6c71-401c-9d19-213951db23fe" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-quobyte-844d5e3f-6c71-401c-9d19-213951db23fe" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2824ede-0d9a-4ca0-b0db-c72cb8b34e71]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:49 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe Sep 02 00:46:49 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:49 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe" returned: 0 in 0.438s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:49 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe Sep 02 00:46:49 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Creating offline snapshot 0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 of volume dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7715f27-1212-4bcc-9428-29ed27c7c1d5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:49 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f Sep 02 00:46:49 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:50 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-844d5e3f-6c71-401c-9d19-213951db23fe" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-quobyte-844d5e3f-6c71-401c-9d19-213951db23fe" released by "delete_volume" :: held 0.874s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Created reservations ['b07da22f-f655-4187-9783-0070e788e3ff', '56b39680-037c-44c2-93d6-1a18daa6543a', 'b0642ec6-ba6a-4d5c-9f9a-2c3e581ee4a1', 'f4f76d79-77ea-4450-be19-4e38d266a09f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:50 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f" returned: 0 in 0.474s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:50 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:46:50 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:50 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 1G Sep 02 00:46:50 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:50 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.412s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:46:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Deleted volume successfully. Sep 02 00:46:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-687e0f06-6936-46bd-a30b-6ce51f0e2a17 tempest-VolumesActionsTest-1624428836 None] Lock "cinder-844d5e3f-6c71-401c-9d19-213951db23fe-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:46:50 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 1G" returned: 0 in 0.682s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:51 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 Sep 02 00:46:51 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:51 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:51 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 is being set with open permissions: ugo+rw Sep 02 00:46:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:51 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 Sep 02 00:46:51 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:51 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:51 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.info Sep 02 00:46:51 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:52 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.info" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:52 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.info is being set with open permissions: ugo+rw Sep 02 00:46:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:52 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.info Sep 02 00:46:52 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:52 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.info" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3b34ea9c-61c8-43ab-83f6-de640dc5b4fa tempest-VolumesSnapshotListTestJSON-706223526 None] Create snapshot completed successfully Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Creating offline snapshot c354148a-a435-49f2-9280-b8234a258d96 of volume dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ab9ec3-272e-4379-adfc-c579cf66a625]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:53 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 Sep 02 00:46:53 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:53 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfde9809-2c01-4d3c-866d-bfc909adff5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:46:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:53 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 1G Sep 02 00:46:53 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:54 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 1G" returned: 0 in 0.541s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:54 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 Sep 02 00:46:54 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:54 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96" returned: 0 in 0.542s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:54 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 is being set with open permissions: ugo+rw Sep 02 00:46:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:54 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 Sep 02 00:46:54 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:55 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96" returned: 0 in 0.293s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4c47d2e6-c0b0-43a4-beec-cea914cc5b35 tempest-VolumesSnapshotListTestJSON-706223526 None] Create snapshot completed successfully Sep 02 00:46:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:46:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:46:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Creating offline snapshot 4f360875-39d5-4775-a7be-61048cb88dc5 of volume dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:46:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[008b707b-67ae-43b0-9fb1-016c043c8369]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:46:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:56 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 Sep 02 00:46:56 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:56 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96" returned: 0 in 0.541s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfde9809-2c01-4d3c-866d-bfc909adff5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:46:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:56 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 1G Sep 02 00:46:56 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:56 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 1G" returned: 0 in 0.592s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:57 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 Sep 02 00:46:57 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:57 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:57 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 is being set with open permissions: ugo+rw Sep 02 00:46:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:46:57 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 Sep 02 00:46:57 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:46:58 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 02 00:46:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5" returned: 0 in 0.617s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:46:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:46:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a56fa450-3ff3-43be-8502-b6e82f97db26 tempest-VolumesSnapshotListTestJSON-706223526 None] Create snapshot completed successfully Sep 02 00:46:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-a4ad9030-cecb-404d-9161-2c3dafece7c5 tempest-ServerActionsTestOtherA-375885117 None] Terminate volume connection completed successfully. Sep 02 00:46:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-a4ad9030-cecb-404d-9161-2c3dafece7c5 tempest-ServerActionsTestOtherA-375885117 None] Deleting attachment eaaae9d0-5b9c-4194-b5f2-997c69e7e893. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:46:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "cinder-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:46:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "cinder-quobyte-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-quobyte-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0" acquired by "delete_volume" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff20e0f4-e5ec-41d4-8bda-c4009cc47f55]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:00 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 Sep 02 00:47:00 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-4f360875-39d5-4775-a7be-61048cb88dc5-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-4f360875-39d5-4775-a7be-61048cb88dc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-quobyte-4f360875-39d5-4775-a7be-61048cb88dc5" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-4f360875-39d5-4775-a7be-61048cb88dc5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Deleting offline snapshot 4f360875-39d5-4775-a7be-61048cb88dc5 of volume dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] snapshot_file for this snap is: volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b58977-7f5c-4878-8fd1-fee32705a262]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:00 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 Sep 02 00:47:00 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:00 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0" returned: 0 in 0.759s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:00 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0 Sep 02 00:47:00 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "cinder-c4a5fb74-6277-49ef-a57c-fcea248e35c0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-c4a5fb74-6277-49ef-a57c-fcea248e35c0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "cinder-quobyte-c4a5fb74-6277-49ef-a57c-fcea248e35c0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-quobyte-c4a5fb74-6277-49ef-a57c-fcea248e35c0" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:01 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0b9c14-f777-4212-8746-3757378de56c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:01 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0" returned: 0 in 0.496s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5" returned: 0 in 0.766s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfde9809-2c01-4d3c-866d-bfc909adff5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-quobyte-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0" released by "delete_volume" :: held 1.371s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c075a5e3-3b4b-4183-b331-831a8d556399]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:01 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 Sep 02 00:47:01 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.quota [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Created reservations ['7b60273f-6ffc-4398-993d-947d53be86da', '3e3a0038-809c-41c1-b9ca-477e13171060', '6971077d-830a-4492-a1b7-989db1536496', '5c4e2b50-1bf6-4835-ad0e-ace5825c559b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:01 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 Sep 02 00:47:01 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:01 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:01 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:01 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0" returned: 0 in 0.581s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:02 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0 Sep 02 00:47:02 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:02 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96" returned: 0 in 0.676s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfde9809-2c01-4d3c-866d-bfc909adff5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:02 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG cinder.manager [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Deleted volume successfully. Sep 02 00:47:02 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 Sep 02 00:47:02 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-eca98c9e-896f-42fd-b089-dfc6c705c2f6 req-e0de39c9-bd76-433d-af37-99d9043bafda tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-25b2b3cf-fad6-4d49-b3f1-0d7418eb6ab0-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:02 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c4a5fb74-6277-49ef-a57c-fcea248e35c0" returned: 0 in 0.552s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-quobyte-c4a5fb74-6277-49ef-a57c-fcea248e35c0" released by "delete_volume" :: held 1.236s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Created reservations ['2eea3605-311e-4a42-8fae-9d7a1fba3987', '4ba0f0db-db05-4d14-8b5d-c66b5fe9dd96', '6c720de5-1e5e-4a95-863a-f30da6d3f130', 'f43714f5-be0a-4c5b-8ac9-dafdc8bee889'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:02 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:02 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:02 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5" returned: 0 in 0.726s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:02 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5 Sep 02 00:47:02 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:03 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.302s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Deleted volume successfully. Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b7a79c6-0f69-4a44-b5e1-94233171a1ce tempest-ServerActionsTestOtherA-375885117 None] Lock "cinder-c4a5fb74-6277-49ef-a57c-fcea248e35c0-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:03 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.4f360875-39d5-4775-a7be-61048cb88dc5" returned: 0 in 0.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-4f360875-39d5-4775-a7be-61048cb88dc5" released by "_delete_snapshot" :: held 2.653s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" released by "delete_snapshot" :: held 2.692s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:03 devstack cinder-volume[87232]: WARNING cinder.quota [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Created reservations ['e34ae3d3-f0f6-4855-beb1-948602572336', '348a75c6-f8c7-46af-ae7c-5cce1e1fa059', 'd036dd46-7926-43bb-891e-070d26a3d27f', '355e9e41-1e36-4542-ba89-a1db7f0bc5c8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Delete snapshot completed successfully. Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfca7a08-1c56-428a-829f-db56ba557294 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-4f360875-39d5-4775-a7be-61048cb88dc5-delete_snapshot" released by "delete_snapshot" :: held 2.848s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-c354148a-a435-49f2-9280-b8234a258d96-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-c354148a-a435-49f2-9280-b8234a258d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-quobyte-c354148a-a435-49f2-9280-b8234a258d96" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-c354148a-a435-49f2-9280-b8234a258d96" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Deleting offline snapshot c354148a-a435-49f2-9280-b8234a258d96 of volume dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] snapshot_file for this snap is: volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbb24c7-0641-4a9a-936c-834ded46fc38]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:04 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 Sep 02 00:47:04 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:04 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96" returned: 0 in 0.566s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfde9809-2c01-4d3c-866d-bfc909adff5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[95202b2f-86db-48ed-8010-b275aa95f6d6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:04 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 Sep 02 00:47:04 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:05 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" returned: 0 in 0.530s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfde9809-2c01-4d3c-866d-bfc909adff5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:05 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 Sep 02 00:47:05 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:05 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:05 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96 Sep 02 00:47:05 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:05 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.c354148a-a435-49f2-9280-b8234a258d96" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-c354148a-a435-49f2-9280-b8234a258d96" released by "_delete_snapshot" :: held 1.909s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" released by "delete_snapshot" :: held 1.936s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Created reservations ['408227a0-6b06-432f-9d93-9b14e434d63a', '81285c3f-4463-43dd-bba6-68c17b0d9571', '2f6ff7cf-7cf8-40b0-8e7d-9c94f3416b35', 'df43c9d3-3c5e-408d-8760-86262829cb22'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Delete snapshot completed successfully. Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c34f0eb6-ec22-422c-9263-2906f8eb25a2 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-c354148a-a435-49f2-9280-b8234a258d96-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-quobyte-0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Deleting offline snapshot 0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 of volume dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] snapshot_file for this snap is: volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05176d-fa8a-475d-b5fe-d753053de802]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:06 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 Sep 02 00:47:06 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:06 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfde9809-2c01-4d3c-866d-bfc909adff5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba9c40f-d171-4513-bcea-69a395e27765]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:06 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f Sep 02 00:47:06 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:06 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:06 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 Sep 02 00:47:06 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:07 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" returned: 0 in 0.552s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:07 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8 Sep 02 00:47:07 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:07 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f.0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8" released by "_delete_snapshot" :: held 1.810s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" released by "delete_snapshot" :: held 1.848s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Created reservations ['ecedcd10-df89-469e-a8cb-7a2a588c6bf4', '980e66a5-8d07-421a-86f4-fa7c299e1a99', '9cdb81dc-2cc0-486c-b98a-7dc31878b252', 'debaeef8-1d26-4748-91b8-343883c31c7c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Delete snapshot completed successfully. Sep 02 00:47:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-74a58742-be69-4f25-82cd-0e076914412b tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-0d9b9de1-1cbf-4f66-b427-e1a6c5b7b6a8-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-dfde9809-2c01-4d3c-866d-bfc909adff5f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-dfde9809-2c01-4d3c-866d-bfc909adff5f-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d27671-8ee9-4429-8fbc-552866944ebd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:08 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f Sep 02 00:47:08 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Flow 'volume_create_manager' (8eaf8b75-739d-4211-a3e2-aa5f57d40a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f72309-e60b-4075-8942-24c642e99e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f72309-e60b-4075-8942-24c642e99e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045459396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4155fd-b1cd-4671-a24e-0c97b773620d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04011dd6e9041e7b08c336e502e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:09Z,use_quota=True,user_id='c72ba25d8df44f549a890fef0fcb09da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80983696-6cfd-4965-8bad-4b2dad31dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80983696-6cfd-4965-8bad-4b2dad31dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e3729-851e-4ba4-8f8c-e6c9809c5737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e3729-851e-4ba4-8f8c-e6c9809c5737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4155fd-b1cd-4671-a24e-0c97b773620d', 'volume_name': 'volume-bd4155fd-b1cd-4671-a24e-0c97b773620d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15715ec3-8958-4e27-ab95-123c5f17b37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15715ec3-8958-4e27-ab95-123c5f17b37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdcc52c-0a9a-43b5-834b-d4a238b8997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Volume bd4155fd-b1cd-4671-a24e-0c97b773620d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4155fd-b1cd-4671-a24e-0c97b773620d', 'volume_size': 1} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1045459396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4155fd-b1cd-4671-a24e-0c97b773620d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04011dd6e9041e7b08c336e502e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:09Z,use_quota=True,user_id='c72ba25d8df44f549a890fef0fcb09da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Creating volume bd4155fd-b1cd-4671-a24e-0c97b773620d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:08 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d 1073741824 Sep 02 00:47:08 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:08 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f" returned: 0 in 0.490s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:09 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f Sep 02 00:47:09 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:09 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dfde9809-2c01-4d3c-866d-bfc909adff5f" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:09 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d 1073741824" returned: 0 in 0.560s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-quobyte-dfde9809-2c01-4d3c-866d-bfc909adff5f" released by "delete_volume" :: held 0.928s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:09 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d Sep 02 00:47:09 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Created reservations ['4f839a32-8631-4892-8552-aa0a8a3c6bd4', '9f3b7ceb-e798-42d2-a626-56605e2e9c29', '010730b0-6628-4d3c-acef-ddae3ff3e5c0', 'a4155a23-a4df-49cf-91c9-80d343950e65'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:09 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:09 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:09 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdcc52c-0a9a-43b5-834b-d4a238b8997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4155fd-b1cd-4671-a24e-0c97b773620d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24a33b6-1466-4e11-a2b7-8cd88e152375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Volume volume-bd4155fd-b1cd-4671-a24e-0c97b773620d (bd4155fd-b1cd-4671-a24e-0c97b773620d): created successfully Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24a33b6-1466-4e11-a2b7-8cd88e152375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Flow 'volume_create_manager' (8eaf8b75-739d-4211-a3e2-aa5f57d40a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5d8135e8-726b-4068-b72a-4a0e2c43ac59 tempest-VolumesListAdminTestJSON-1391710327 None] Created volume successfully. Sep 02 00:47:09 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.255s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Deleted volume successfully. Sep 02 00:47:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3b78db-fa9f-41e7-bf73-fe6e858c69d4 tempest-VolumesSnapshotListTestJSON-706223526 None] Lock "cinder-dfde9809-2c01-4d3c-866d-bfc909adff5f-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Flow 'volume_create_manager' (50b0353c-abc8-4b7c-90ba-631be066ba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a1ba7-be0b-4610-a9f4-72e8ed8dc42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7a1ba7-be0b-4610-a9f4-72e8ed8dc42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1447538654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea64ab4-3b8b-4c25-9e38-cb362206f79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3fd98f690b42e18a4986a967666ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:11Z,use_quota=True,user_id='05fa3be3da324cefb116d008e439afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f39f3-45d0-4c62-aaeb-08bafe7ca2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f39f3-45d0-4c62-aaeb-08bafe7ca2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1482aaf-ba68-4a77-b166-b027e2ed1d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1482aaf-ba68-4a77-b166-b027e2ed1d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea64ab4-3b8b-4c25-9e38-cb362206f79d', 'volume_name': 'volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fdc43c-074a-4924-af18-17dbd2e87e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fdc43c-074a-4924-af18-17dbd2e87e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d512a7e-712e-4a51-9c6e-590a1e83230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Volume 4ea64ab4-3b8b-4c25-9e38-cb362206f79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d', 'volume_size': 1} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1447538654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea64ab4-3b8b-4c25-9e38-cb362206f79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3fd98f690b42e18a4986a967666ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:11Z,use_quota=True,user_id='05fa3be3da324cefb116d008e439afee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Creating volume 4ea64ab4-3b8b-4c25-9e38-cb362206f79d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:11 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:11 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d 1073741824 Sep 02 00:47:11 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Flow 'volume_create_manager' (b1e7b876-b337-467f-abd3-5227a41860b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981efa0d-cca0-4c06-9ed3-6a3e63b4c2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981efa0d-cca0-4c06-9ed3-6a3e63b4c2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2094484352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04011dd6e9041e7b08c336e502e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:11Z,use_quota=True,user_id='c72ba25d8df44f549a890fef0fcb09da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be268b9-d850-4b74-91a6-b159de0091df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be268b9-d850-4b74-91a6-b159de0091df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdcfafc-8ba3-471b-9ad8-899859e12222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdcfafc-8ba3-471b-9ad8-899859e12222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4', 'volume_name': 'volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68082889-d91c-4980-82df-0c29716860af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68082889-d91c-4980-82df-0c29716860af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d736fc85-76fc-408b-a061-b4055fa9c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Volume 8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4', 'volume_size': 1} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:11 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d 1073741824" returned: 0 in 0.635s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:11 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d Sep 02 00:47:11 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:12 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2094484352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04011dd6e9041e7b08c336e502e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:11Z,use_quota=True,user_id='c72ba25d8df44f549a890fef0fcb09da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Creating volume 8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:12 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d512a7e-712e-4a51-9c6e-590a1e83230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:12 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 1073741824 Sep 02 00:47:12 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318b4eba-427f-4a5d-afa5-22181c89dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Volume volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d (4ea64ab4-3b8b-4c25-9e38-cb362206f79d): created successfully Sep 02 00:47:12 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318b4eba-427f-4a5d-afa5-22181c89dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:12 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Flow 'volume_create_manager' (50b0353c-abc8-4b7c-90ba-631be066ba69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8b247837-1a08-47eb-9a69-1a2ffe86e5bf tempest-AttachVolumeNegativeTest-298902001 None] Created volume successfully. Sep 02 00:47:12 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.465s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:47:12 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 1073741824" returned: 0 in 0.634s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:12 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 Sep 02 00:47:12 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:13 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d736fc85-76fc-408b-a061-b4055fa9c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c94b6b-61c6-460a-b7b1-3d23f62a02d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Volume volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 (8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4): created successfully Sep 02 00:47:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c94b6b-61c6-460a-b7b1-3d23f62a02d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Flow 'volume_create_manager' (b1e7b876-b337-467f-abd3-5227a41860b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fbb8ebe0-0203-4a8a-84a9-6e125b206bd1 tempest-VolumesListAdminTestJSON-1391710327 None] Created volume successfully. Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=118,cinder:INSERT=41,cinder:UPDATE=171,cinder:DELETE=15 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8a02ec24-0720-43b1-accd-d376fbcc76e0 req-83252e1a-67a0-43ad-9a10-b66fdc0129dc tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8a02ec24-0720-43b1-accd-d376fbcc76e0 req-83252e1a-67a0-43ad-9a10-b66fdc0129dc tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8a02ec24-0720-43b1-accd-d376fbcc76e0 req-83252e1a-67a0-43ad-9a10-b66fdc0129dc tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Flow 'volume_create_manager' (7c6c2cc5-fe15-4a30-aea8-e04d31b81bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406d9b9b-221b-4534-af29-6664024bea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-8a02ec24-0720-43b1-accd-d376fbcc76e0 req-83252e1a-67a0-43ad-9a10-b66fdc0129dc tempest-AttachVolumeNegativeTest-298902001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd65c653f-e365-49c2-b784-9c4dbeeb9781', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406d9b9b-221b-4534-af29-6664024bea32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1886957202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97df3587-c101-46a0-98f5-ef6fd3ebad1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04011dd6e9041e7b08c336e502e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:14Z,use_quota=True,user_id='c72ba25d8df44f549a890fef0fcb09da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77d4117-029c-48ee-ad04-02366779cab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77d4117-029c-48ee-ad04-02366779cab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c383172-0cc0-4f6a-a33b-c414b4e008b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c383172-0cc0-4f6a-a33b-c414b4e008b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97df3587-c101-46a0-98f5-ef6fd3ebad1e', 'volume_name': 'volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ddc96d-0982-40ee-84b8-e92e0b88ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ddc96d-0982-40ee-84b8-e92e0b88ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073e351b-b76a-4a81-a39f-a538eec91bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Volume 97df3587-c101-46a0-98f5-ef6fd3ebad1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e', 'volume_size': 1} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1886957202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97df3587-c101-46a0-98f5-ef6fd3ebad1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04011dd6e9041e7b08c336e502e86d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:14Z,use_quota=True,user_id='c72ba25d8df44f549a890fef0fcb09da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Creating volume 97df3587-c101-46a0-98f5-ef6fd3ebad1e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=144,cinder:INSERT=36,cinder:UPDATE=152,cinder:DELETE=14 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:47:14 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e 1073741824 Sep 02 00:47:14 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-8a02ec24-0720-43b1-accd-d376fbcc76e0 req-83252e1a-67a0-43ad-9a10-b66fdc0129dc tempest-AttachVolumeNegativeTest-298902001 None] attachment_update completed successfully. Sep 02 00:47:14 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e 1073741824" returned: 0 in 0.637s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:15 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e Sep 02 00:47:15 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Flow 'volume_create_manager' (0ab80fd5-faff-468c-9343-3174cc18fd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1364b28-5c98-4a54-a552-2fa33e2345d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1364b28-5c98-4a54-a552-2fa33e2345d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193147956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a687386d-6993-4280-9c64-d987dade59e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf8d872328345c8a611d496759b6a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:15Z,use_quota=True,user_id='ac2bd34d5b9649659b87a066c04fd7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109aacc0-49d2-4638-80fe-f3f5b2bf7430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109aacc0-49d2-4638-80fe-f3f5b2bf7430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f0c2ff-6cec-4032-9a67-2d5cb7a2a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f0c2ff-6cec-4032-9a67-2d5cb7a2a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a687386d-6993-4280-9c64-d987dade59e8', 'volume_name': 'volume-a687386d-6993-4280-9c64-d987dade59e8', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d2da7b-141a-4aed-998d-c986b35265c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d2da7b-141a-4aed-998d-c986b35265c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:15 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c48f8f-694b-46e7-a9b3-a33d17bb4279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Volume a687386d-6993-4280-9c64-d987dade59e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a687386d-6993-4280-9c64-d987dade59e8', 'volume_size': 2} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193147956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a687386d-6993-4280-9c64-d987dade59e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf8d872328345c8a611d496759b6a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:15Z,use_quota=True,user_id='ac2bd34d5b9649659b87a066c04fd7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Creating volume a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:15 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 2147483648 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:15 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 2147483648 Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073e351b-b76a-4a81-a39f-a538eec91bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:15 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03e30ad-fe98-4193-8a4f-3cc647370771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Volume volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e (97df3587-c101-46a0-98f5-ef6fd3ebad1e): created successfully Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03e30ad-fe98-4193-8a4f-3cc647370771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Flow 'volume_create_manager' (7c6c2cc5-fe15-4a30-aea8-e04d31b81bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1f1a4776-2677-434a-85bb-a28c1f192ecb tempest-VolumesListAdminTestJSON-1391710327 None] Created volume successfully. Sep 02 00:47:15 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 2147483648" returned: 0 in 0.565s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:16 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 Sep 02 00:47:16 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:16 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c48f8f-694b-46e7-a9b3-a33d17bb4279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a687386d-6993-4280-9c64-d987dade59e8', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcffa2ae-2c59-42a1-a37b-ac062c93b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Volume volume-a687386d-6993-4280-9c64-d987dade59e8 (a687386d-6993-4280-9c64-d987dade59e8): created successfully Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcffa2ae-2c59-42a1-a37b-ac062c93b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Flow 'volume_create_manager' (0ab80fd5-faff-468c-9343-3174cc18fd3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5b60b5c3-9680-44c9-929e-878aac5ff776 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Created volume successfully. Sep 02 00:47:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-3c907ace-eef1-4d7f-9863-7573476ee1d6 req-4b319ad5-58c6-434b-905d-a02c6f7daacd tempest-AttachVolumeNegativeTest-298902001 None] Terminate volume connection completed successfully. Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-3c907ace-eef1-4d7f-9863-7573476ee1d6 req-4b319ad5-58c6-434b-905d-a02c6f7daacd tempest-AttachVolumeNegativeTest-298902001 None] Deleting attachment d65c653f-e365-49c2-b784-9c4dbeeb9781. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Flow 'volume_create_manager' (3f958ed9-cb13-4f97-a55e-79e2befe8750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22c0ead-9bb0-463b-8acb-133624d58393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22c0ead-9bb0-463b-8acb-133624d58393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1133118702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b26dc8-9043-4f35-b22b-51f73a31b0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e072cb58e254c78a155e081ad684612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:17Z,use_quota=True,user_id='29353e5e7c204445aa2531ed8886cc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fa0a4b-ab5c-4550-97de-a490b75a78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fa0a4b-ab5c-4550-97de-a490b75a78d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4950acc4-0f39-48d7-bf53-915875c54e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4950acc4-0f39-48d7-bf53-915875c54e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b26dc8-9043-4f35-b22b-51f73a31b0a3', 'volume_name': 'volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0695d8-85e0-4354-818a-f665cd7219e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0695d8-85e0-4354-818a-f665cd7219e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aede4f31-bfd3-47dd-8f4e-59605aa5904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Volume e7b26dc8-9043-4f35-b22b-51f73a31b0a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3', 'volume_size': 1} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1133118702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b26dc8-9043-4f35-b22b-51f73a31b0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e072cb58e254c78a155e081ad684612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:17Z,use_quota=True,user_id='29353e5e7c204445aa2531ed8886cc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Creating volume e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:16 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:16 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 1073741824 Sep 02 00:47:16 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:17 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 1073741824" returned: 0 in 0.591s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:17 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 Sep 02 00:47:17 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Flow 'volume_create_manager' (8274b480-e575-43ee-a9bb-b1677377c0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698ef8c0-330f-43fc-8aa2-e99d34538633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698ef8c0-330f-43fc-8aa2-e99d34538633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6969f1-c828-4d1c-a097-262f1430a428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfe1f79d7f04f78b7d655f85474eebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:18Z,use_quota=True,user_id='bc75b3c9c71e4498abb17e122c510266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b5df78-98eb-40d4-9273-1415b6a77ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b5df78-98eb-40d4-9273-1415b6a77ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a10d096-79bb-4b3a-92e0-5443bb01b5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a10d096-79bb-4b3a-92e0-5443bb01b5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6969f1-c828-4d1c-a097-262f1430a428', 'volume_name': 'volume-0d6969f1-c828-4d1c-a097-262f1430a428', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:17 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d4732-64b6-4a03-9b82-c9fc36422669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d4732-64b6-4a03-9b82-c9fc36422669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5b7c2b-9fd8-44c0-9d0f-6ee6184341a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Volume 0d6969f1-c828-4d1c-a097-262f1430a428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6969f1-c828-4d1c-a097-262f1430a428', 'volume_size': 1} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.054s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Creating offline snapshot 2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 of volume a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aede4f31-bfd3-47dd-8f4e-59605aa5904d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54dd06-0e5c-4520-a5a1-fd3d8d9f40e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d8fc84-ab15-46bb-b54c-5c2238bef129]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Volume volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 (e7b26dc8-9043-4f35-b22b-51f73a31b0a3): created successfully Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54dd06-0e5c-4520-a5a1-fd3d8d9f40e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Flow 'volume_create_manager' (3f958ed9-cb13-4f97-a55e-79e2befe8750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-732f1887-166c-4700-b07a-5ff2d906b00d req-03d8088b-64a5-41cc-b84c-7e9db8422276 tempest-VolumesSnapshotsTestJSON-722356831 None] Created volume successfully. Sep 02 00:47:18 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 Sep 02 00:47:18 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:18 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 2G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:18 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 2G Sep 02 00:47:18 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:18 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 2G" returned: 0 in 0.562s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a687386d-6993-4280-9c64-d987dade59e8 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:19 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a687386d-6993-4280-9c64-d987dade59e8 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 Sep 02 00:47:19 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:19 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a687386d-6993-4280-9c64-d987dade59e8 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 is being set with open permissions: ugo+rw Sep 02 00:47:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:19 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 Sep 02 00:47:19 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:19 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" returned: 0 in 0.255s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:19 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.info Sep 02 00:47:19 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:19 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.info" returned: 0 in 0.281s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.info is being set with open permissions: ugo+rw Sep 02 00:47:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:19 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.info Sep 02 00:47:19 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:20 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.info" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.349s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6969f1-c828-4d1c-a097-262f1430a428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bfe1f79d7f04f78b7d655f85474eebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:18Z,use_quota=True,user_id='bc75b3c9c71e4498abb17e122c510266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Creating volume 0d6969f1-c828-4d1c-a097-262f1430a428 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:20 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:20 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 1073741824 Sep 02 00:47:20 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-497b818d-0fa3-4215-9e35-e85b99dacc36 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Create snapshot completed successfully Sep 02 00:47:20 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 1073741824" returned: 0 in 0.517s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:20 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 Sep 02 00:47:20 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "cinder-2eb470a4-6bfd-44a3-8202-99b2e4b1baa0-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-2eb470a4-6bfd-44a3-8202-99b2e4b1baa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "cinder-quobyte-a687386d-6993-4280-9c64-d987dade59e8" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-quobyte-a687386d-6993-4280-9c64-d987dade59e8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "cinder-quobyte-2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-quobyte-2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Deleting offline snapshot 2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 of volume a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] snapshot_file for this snap is: volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf63f7d2-e841-4038-86aa-599764733cd3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:21 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.869s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5b7c2b-9fd8-44c0-9d0f-6ee6184341a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6969f1-c828-4d1c-a097-262f1430a428', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16943bbb-714b-4b23-9be8-aca1de4e783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Creating offline snapshot 5c06eb15-2971-42de-879c-2f393c8ede8a of volume e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:47:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Volume volume-0d6969f1-c828-4d1c-a097-262f1430a428 (0d6969f1-c828-4d1c-a097-262f1430a428): created successfully Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16943bbb-714b-4b23-9be8-aca1de4e783e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Flow 'volume_create_manager' (8274b480-e575-43ee-a9bb-b1677377c0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[434efd0e-6b6d-4626-b571-da43869f558a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f8e163ee-77f2-4f52-bef7-195c3ad02d51 tempest-VolumesListAdminTestJSON-839785921 None] Created volume successfully. Sep 02 00:47:21 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 Sep 02 00:47:21 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:21 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 Sep 02 00:47:21 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:21 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a687386d-6993-4280-9c64-d987dade59e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d910ec-e03f-4749-80de-8c4961174d95]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:21 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:21 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a 1G Sep 02 00:47:21 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:21 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 Sep 02 00:47:21 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:21 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:21 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 Sep 02 00:47:21 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:22 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a 1G" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:22 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a Sep 02 00:47:22 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Acquiring lock "cinder-0d6969f1-c828-4d1c-a097-262f1430a428-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Lock "cinder-0d6969f1-c828-4d1c-a097-262f1430a428-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:22 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Acquiring lock "cinder-quobyte-0d6969f1-c828-4d1c-a097-262f1430a428" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Lock "cinder-quobyte-0d6969f1-c828-4d1c-a097-262f1430a428" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:22 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0 Sep 02 00:47:22 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f118ba02-79cf-428f-a0ea-735f39a7cdbf]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "cinder-97df3587-c101-46a0-98f5-ef6fd3ebad1e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-97df3587-c101-46a0-98f5-ef6fd3ebad1e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "cinder-quobyte-97df3587-c101-46a0-98f5-ef6fd3ebad1e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-quobyte-97df3587-c101-46a0-98f5-ef6fd3ebad1e" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:22 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:22 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a is being set with open permissions: ugo+rw Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb3677-c822-42a0-938b-c85c033a60ed]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:22 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8.2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:22 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a Sep 02 00:47:22 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:22 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 Sep 02 00:47:22 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-quobyte-2eb470a4-6bfd-44a3-8202-99b2e4b1baa0" released by "_delete_snapshot" :: held 1.658s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-quobyte-a687386d-6993-4280-9c64-d987dade59e8" released by "delete_snapshot" :: held 1.690s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:22 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e Sep 02 00:47:22 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Created reservations ['1b39a1f5-dc3a-428f-82e2-8cc658d5b93a', '452e3090-1261-42a6-a92a-b49e7777d0d7', 'e657314e-ca4f-4de0-953f-4d0ca5f39720', 'a00a5050-faef-4543-867d-90747d908c82'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Delete snapshot completed successfully. Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "cinder-4ea64ab4-3b8b-4c25-9e38-cb362206f79d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ffa96d-7a44-4946-b29f-de30b2aa9dc8 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-2eb470a4-6bfd-44a3-8202-99b2e4b1baa0-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-4ea64ab4-3b8b-4c25-9e38-cb362206f79d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:22 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428" returned: 0 in 0.621s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e" returned: 0 in 0.460s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428 Sep 02 00:47:23 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "cinder-quobyte-4ea64ab4-3b8b-4c25-9e38-cb362206f79d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:23 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e Sep 02 00:47:23 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-quobyte-4ea64ab4-3b8b-4c25-9e38-cb362206f79d" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:23 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a" returned: 0 in 0.560s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fdffb1-43f6-4849-ab69-785361cc2b26]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.info Sep 02 00:47:23 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d Sep 02 00:47:23 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "cinder-a687386d-6993-4280-9c64-d987dade59e8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-a687386d-6993-4280-9c64-d987dade59e8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:23 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0d6969f1-c828-4d1c-a097-262f1430a428" returned: 0 in 0.433s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-97df3587-c101-46a0-98f5-ef6fd3ebad1e" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Lock "cinder-quobyte-0d6969f1-c828-4d1c-a097-262f1430a428" released by "delete_volume" :: held 1.142s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-quobyte-97df3587-c101-46a0-98f5-ef6fd3ebad1e" released by "delete_volume" :: held 0.970s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "cinder-quobyte-a687386d-6993-4280-9c64-d987dade59e8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-quobyte-a687386d-6993-4280-9c64-d987dade59e8" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:23 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.info" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.info is being set with open permissions: ugo+rw Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5327960-dc93-4f07-a7be-b2a21a376e15]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.info Sep 02 00:47:23 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d" returned: 0 in 0.491s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d Sep 02 00:47:23 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Created reservations ['199b04c2-38cc-4de9-a7e1-150df26021a2', 'b09973d4-1be7-4418-be17-595ac6529c6e', 'd283f37f-b22c-473f-ba8b-f9e817b7cd47', 'c5301d08-c365-4354-a6c1-027ed0c8720f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Created reservations ['e95dd6ea-fe8f-4125-a1c9-3c808731a5b1', '70a9ff68-a8ed-4c49-b75f-1456ba627616', '6a83a106-f5d4-4e6e-b7cf-447be880df2a', '999ef1d6-9630-44bf-b30d-a98193a10d10'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:23 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:23 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:23 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:23 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.info" returned: 0 in 0.320s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:23 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a725d684-8047-4ba7-ab0a-ff102e073850 req-e81e1e35-b8dd-4b75-8a49-8ba45c43d4d8 tempest-VolumesSnapshotsTestJSON-722356831 None] Create snapshot completed successfully Sep 02 00:47:23 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ea64ab4-3b8b-4c25-9e38-cb362206f79d" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-quobyte-4ea64ab4-3b8b-4c25-9e38-cb362206f79d" released by "delete_volume" :: held 0.927s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:24 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Created reservations ['3079fd82-a4fb-424a-89e5-a755b0948454', 'ca0fa70c-2e81-4ee6-bbf5-bd3c4272ba82', '46900480-8e05-44cd-b0ab-d4b00ae880f2', 'c07d4ab8-0fd4-4fc3-870c-1f2b78080d9a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Deleted volume successfully. Sep 02 00:47:24 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.327s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:24 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Deleted volume successfully. Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8" returned: 0 in 0.616s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce1f2e22-e9ed-4546-8d22-379ff0431570 tempest-VolumesListAdminTestJSON-839785921 None] Lock "cinder-0d6969f1-c828-4d1c-a097-262f1430a428-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:24 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8 Sep 02 00:47:24 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6a5026e-3e08-43ab-8fef-21ce9ad79201 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-97df3587-c101-46a0-98f5-ef6fd3ebad1e-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:24 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:24 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:24 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a687386d-6993-4280-9c64-d987dade59e8" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-quobyte-a687386d-6993-4280-9c64-d987dade59e8" released by "delete_volume" :: held 0.968s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:24 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Deleted volume successfully. Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Created reservations ['2096efab-5d36-4798-bfbf-087abb956dc3', 'd726a6c0-0e8b-4053-9d93-ce84ceac4d99', '1925a0d1-c62e-4ae0-975b-ee18773e95d8', '7439cc42-4ea3-4043-81d4-bc4c9d24104b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-472e7757-2f22-47c6-8472-41180b4a95ee tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-4ea64ab4-3b8b-4c25-9e38-cb362206f79d-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:24 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:24 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "cinder-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "cinder-quobyte-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-quobyte-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a996e51b-e605-48db-a73b-4faf903f5ff9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:24 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Deleted volume successfully. Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "cinder-5c06eb15-2971-42de-879c-2f393c8ede8a-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-73e08df2-e200-4b69-979e-2bbf995bd3c2 tempest-VolumesSnapshotNegativeTestJSON-1468954688 None] Lock "cinder-a687386d-6993-4280-9c64-d987dade59e8-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-5c06eb15-2971-42de-879c-2f393c8ede8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "cinder-quobyte-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-quobyte-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "cinder-quobyte-5c06eb15-2971-42de-879c-2f393c8ede8a" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:24 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 Sep 02 00:47:24 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-quobyte-5c06eb15-2971-42de-879c-2f393c8ede8a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Deleting offline snapshot 5c06eb15-2971-42de-879c-2f393c8ede8a of volume e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] snapshot_file for this snap is: volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4f55c-5c26-4378-afb7-396326a32154]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:25 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a Sep 02 00:47:25 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:25 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:25 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4 Sep 02 00:47:25 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "cinder-9107adc4-4b7d-4350-bd33-3a2068a29d62-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-9107adc4-4b7d-4350-bd33-3a2068a29d62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:25 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "cinder-quobyte-9107adc4-4b7d-4350-bd33-3a2068a29d62" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a" returned: 0 in 0.440s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-quobyte-9107adc4-4b7d-4350-bd33-3a2068a29d62" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d603b6-6fd1-41dc-9816-2798afd91940]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:25 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[db34845c-b1bc-48ac-9667-ce18ea90b042]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-quobyte-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4" released by "delete_volume" :: held 0.766s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:25 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 Sep 02 00:47:25 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Created reservations ['62763636-5d05-4c6f-a4cd-bff0bcd7b9ac', '1f3059cf-4187-4eae-9b5e-02471c0fd5ac', 'a3d750c4-8d87-47f0-bc1b-d6c07a9dd0c1', '6180a7e2-7203-4bb3-ac11-c56f5276a04f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:25 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 Sep 02 00:47:25 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:25 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:25 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:25 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:25 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a Sep 02 00:47:25 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:26 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62" returned: 0 in 0.511s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:26 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:26 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62 Sep 02 00:47:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Deleted volume successfully. Sep 02 00:47:26 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "cinder-bd4155fd-b1cd-4671-a24e-0c97b773620d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-bd4155fd-b1cd-4671-a24e-0c97b773620d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7e27a5d1-c1b3-4c95-a362-8f99e66ff0e1 tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-8e16bf15-4d5d-4b0a-b98c-e8dbad94b0c4-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "cinder-quobyte-bd4155fd-b1cd-4671-a24e-0c97b773620d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-quobyte-bd4155fd-b1cd-4671-a24e-0c97b773620d" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5af01a-0eef-4fb4-8eec-39724025fea2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:26 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9107adc4-4b7d-4350-bd33-3a2068a29d62" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:26 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d Sep 02 00:47:26 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-quobyte-9107adc4-4b7d-4350-bd33-3a2068a29d62" released by "delete_volume" :: held 0.915s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:26 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a" returned: 0 in 0.511s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:26 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a Sep 02 00:47:26 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Created reservations ['d40202ce-4fcb-4c50-9369-c9e4a5169427', '2033df1a-8b97-47f3-8f96-eca2655c9f6a', '28b4402a-7eaf-4d1f-81cf-748c2e1a5f01', '933b56a8-ebcc-4047-941a-4d9271f957d9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:26 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:26 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:26 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3.5c06eb15-2971-42de-879c-2f393c8ede8a" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:26 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d" returned: 0 in 0.550s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-quobyte-5c06eb15-2971-42de-879c-2f393c8ede8a" released by "_delete_snapshot" :: held 1.855s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-quobyte-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" released by "delete_snapshot" :: held 1.888s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:26 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d Sep 02 00:47:26 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.quota [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Created reservations ['c5c9c26e-b393-4904-962c-b0a12b4aa89d', 'bf234e69-eaec-407e-becf-dd1d76f6a97d', '156955bb-58e1-4e67-8dab-5973cdc040cd', '15d6fabc-d985-49a6-822c-b3daf6e5245e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:26 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Deleted volume successfully. Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4635aac5-a70d-4145-830a-c6de52c36b8b tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-9107adc4-4b7d-4350-bd33-3a2068a29d62-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Delete snapshot completed successfully. Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-84697f6f-b1e6-4a37-b07b-df2dc1e38832 req-23024990-6b7f-4234-85d2-3fed05ace75b tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-5c06eb15-2971-42de-879c-2f393c8ede8a-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:27 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd4155fd-b1cd-4671-a24e-0c97b773620d" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-quobyte-bd4155fd-b1cd-4671-a24e-0c97b773620d" released by "delete_volume" :: held 0.970s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "cinder-e7b26dc8-9043-4f35-b22b-51f73a31b0a3-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Created reservations ['8dcf829d-36d3-4d04-a8f5-baf2f470dae5', '0fa95c70-ead2-4d40-a4c0-7483c5c47e9a', '77ca9e79-cdb1-4f43-acfd-5f26c008bfe0', '3e5e761e-20a9-42a8-8100-8a636699343f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-e7b26dc8-9043-4f35-b22b-51f73a31b0a3-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "cinder-quobyte-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-quobyte-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d1c9ef-50ca-4174-b5c8-5cc44fc3be8e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:27 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:27 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:27 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 Sep 02 00:47:27 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:27 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.279s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Deleted volume successfully. Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fe8d342-32f4-42c5-a6b4-8bb266aca1ec tempest-VolumesListAdminTestJSON-1391710327 None] Lock "cinder-bd4155fd-b1cd-4671-a24e-0c97b773620d-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:27 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" returned: 0 in 0.450s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "cinder-e02598c8-00bc-46cd-958b-547e45f9b08c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:27 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3 Sep 02 00:47:27 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-e02598c8-00bc-46cd-958b-547e45f9b08c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "cinder-quobyte-e02598c8-00bc-46cd-958b-547e45f9b08c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-quobyte-e02598c8-00bc-46cd-958b-547e45f9b08c" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a66790-5a99-404e-96c3-ef12b22defba]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:28 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c Sep 02 00:47:28 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:28 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" returned: 0 in 0.293s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-quobyte-e7b26dc8-9043-4f35-b22b-51f73a31b0a3" released by "delete_volume" :: held 0.815s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.quota [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Created reservations ['4989cba0-483f-456d-a749-d50a6d76a4fa', '5cef43da-40fc-427c-a859-66ce28b1da5d', '8dcd09cf-62cd-4066-99c6-4bc718cd664a', '94169a4d-a7de-47c5-8f55-3985a7c413b7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:28 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:28 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:28 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:28 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c Sep 02 00:47:28 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:28 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.manager [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Deleted volume successfully. Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-534b1077-b3b7-4dc9-ba8e-e5f9f8a7b9c5 req-f0e0a2f9-d947-4206-a035-343e9201c045 tempest-VolumesSnapshotsTestJSON-722356831 None] Lock "cinder-e7b26dc8-9043-4f35-b22b-51f73a31b0a3-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:28 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e02598c8-00bc-46cd-958b-547e45f9b08c" returned: 0 in 0.293s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-quobyte-e02598c8-00bc-46cd-958b-547e45f9b08c" released by "delete_volume" :: held 0.835s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Created reservations ['e06842cf-8df2-4d59-a360-01d2e48b3ea6', '8b9bb118-988f-4165-be78-72659378b585', 'bff94e0c-fde9-4b7e-81e8-2d13883e7858', 'b1567d5f-1926-43ec-810c-be2c6ce75eab'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:29 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:29 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:29 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Deleted volume successfully. Sep 02 00:47:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b7b1f0f6-48d5-4b67-a1c2-c5d4d8b833c9 tempest-AttachVolumeNegativeTest-298902001 None] Lock "cinder-e02598c8-00bc-46cd-958b-547e45f9b08c-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5e005423-4a55-4afa-bc14-34882195fdf0 tempest-GroupSnapshotsTest-1743352231 None] Group tempest-GroupSnapshotsTest-Group-169934456: creating Sep 02 00:47:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5e005423-4a55-4afa-bc14-34882195fdf0 tempest-GroupSnapshotsTest-1743352231 None] Group tempest-GroupSnapshotsTest-Group-169934456: created successfully Sep 02 00:47:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5e005423-4a55-4afa-bc14-34882195fdf0 tempest-GroupSnapshotsTest-1743352231 None] Create group completed successfully. Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (49bd2350-2aaa-40e1-8799-cf96a5b3e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0df497-bf0c-4ba8-9637-54b4a8810f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0df497-bf0c-4ba8-9637-54b4a8810f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343130928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66b098ba-8787-4fcd-ad2b-553304e2945b,host='devstack@QuobyteHD#QuobyteHD',id=5ffbc67a-4c8f-4d3a-bf8c-20163474440f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:39Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b71d658a-250b-4cce-a1c4-330d4d4f2df7),volume_type_id=b71d658a-250b-4cce-a1c4-330d4d4f2df7)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219a3928-6a3a-44f0-a798-90b144414eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219a3928-6a3a-44f0-a798-90b144414eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74cf0cd-04f8-4620-99e7-ef03dd74a7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74cf0cd-04f8-4620-99e7-ef03dd74a7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ffbc67a-4c8f-4d3a-bf8c-20163474440f', 'volume_name': 'volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36aaa147-d13d-4770-9137-0cd78b0fd032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36aaa147-d13d-4770-9137-0cd78b0fd032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10b78b1-75e9-4c13-aa18-a2ed1def5b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Volume 5ffbc67a-4c8f-4d3a-bf8c-20163474440f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f', 'volume_size': 1} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66b098ba-8787-4fcd-ad2b-553304e2945b,created_at=2026-09-01T22:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343130928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66b098ba-8787-4fcd-ad2b-553304e2945b,host='devstack@QuobyteHD#QuobyteHD',id=5ffbc67a-4c8f-4d3a-bf8c-20163474440f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:39Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b71d658a-250b-4cce-a1c4-330d4d4f2df7),volume_type_id=b71d658a-250b-4cce-a1c4-330d4d4f2df7)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Creating volume 5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:39 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:39 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f 1073741824 Sep 02 00:47:39 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:39 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f 1073741824" returned: 0 in 0.620s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:39 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f Sep 02 00:47:39 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:40 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" returned: 0 in 0.463s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10b78b1-75e9-4c13-aa18-a2ed1def5b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7599ef-0d61-4bda-a25f-3d069747e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Volume volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f (5ffbc67a-4c8f-4d3a-bf8c-20163474440f): created successfully Sep 02 00:47:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7599ef-0d61-4bda-a25f-3d069747e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (49bd2350-2aaa-40e1-8799-cf96a5b3e243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b388c74b-0541-4a44-aaca-ece497619a2a tempest-GroupSnapshotsTest-1743352231 None] Created volume successfully. Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Flow 'volume_create_manager' (8ba36178-c5f0-4048-bbd2-3cefd59c3ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bb0cf0-514e-4809-859d-a02f8882addd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bb0cf0-514e-4809-859d-a02f8882addd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-985625794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae442317-6f79-40f0-adc8-1c8cf32f9a38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e0bda8010dd497d9b9f737d1adb05af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:41Z,use_quota=True,user_id='4c3db030515b4d169f7a6779b094ae00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc19c131-db1b-45bf-91d2-621ab0c1f427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc19c131-db1b-45bf-91d2-621ab0c1f427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac2d838-a9de-4ad5-94b0-c4686e399d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac2d838-a9de-4ad5-94b0-c4686e399d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae442317-6f79-40f0-adc8-1c8cf32f9a38', 'volume_name': 'volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5b4f3-6508-49f4-a47a-5b68dbbfe16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5b4f3-6508-49f4-a47a-5b68dbbfe16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2b0c4b-4d88-4081-98d8-4aae93607c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Volume ae442317-6f79-40f0-adc8-1c8cf32f9a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38', 'volume_size': 1} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-985625794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae442317-6f79-40f0-adc8-1c8cf32f9a38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e0bda8010dd497d9b9f737d1adb05af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:41Z,use_quota=True,user_id='4c3db030515b4d169f7a6779b094ae00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Creating volume ae442317-6f79-40f0-adc8-1c8cf32f9a38 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:41 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:41 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 1073741824 Sep 02 00:47:41 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] GroupSnapshot dde91c2b-99e7-4477-b8da-bca42684294b: creating. Sep 02 00:47:42 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 1073741824" returned: 0 in 0.641s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Group snapshot dde91c2b-99e7-4477-b8da-bca42684294b: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:42 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 Sep 02 00:47:42 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:42 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.375s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2b0c4b-4d88-4081-98d8-4aae93607c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a3773e-c557-4dcd-864a-3180f20dd360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Creating offline snapshot fbef09ad-c185-4fd6-b4e9-0fe798863c68 of volume 5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:47:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Volume volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 (ae442317-6f79-40f0-adc8-1c8cf32f9a38): created successfully Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a3773e-c557-4dcd-864a-3180f20dd360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Flow 'volume_create_manager' (8ba36178-c5f0-4048-bbd2-3cefd59c3ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59f3e8d-e533-48e5-b71a-4d45682c5640]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-795dff15-8dbc-44ea-861f-674826f42022 req-f49cfed0-a7f4-4fea-8c69-39f54e542b04 tempest-VolumesGetTestJSON-1666319860 None] Created volume successfully. Sep 02 00:47:42 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f Sep 02 00:47:42 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:42 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" returned: 0 in 0.414s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:42 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 1G Sep 02 00:47:42 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:43 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 1G" returned: 0 in 0.557s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:43 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 Sep 02 00:47:43 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:43 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:43 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:47:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:43 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 Sep 02 00:47:43 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Acquiring lock "cinder-ae442317-6f79-40f0-adc8-1c8cf32f9a38-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Lock "cinder-ae442317-6f79-40f0-adc8-1c8cf32f9a38-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Acquiring lock "cinder-quobyte-ae442317-6f79-40f0-adc8-1c8cf32f9a38" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Lock "cinder-quobyte-ae442317-6f79-40f0-adc8-1c8cf32f9a38" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c2a4f1-2651-40f8-aa35-cc5f311b6fb4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:44 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:44 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 Sep 02 00:47:44 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:44 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.info Sep 02 00:47:44 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:44 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38" returned: 0 in 0.402s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:44 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.info" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:44 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:44 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38 Sep 02 00:47:44 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:44 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.info Sep 02 00:47:44 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:44 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ae442317-6f79-40f0-adc8-1c8cf32f9a38" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Lock "cinder-quobyte-ae442317-6f79-40f0-adc8-1c8cf32f9a38" released by "delete_volume" :: held 0.815s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:45 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.info" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG cinder.quota [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Created reservations ['9e647350-b25e-4407-af6a-554890f38918', '55518ea7-2a46-4d69-8c84-0026908d4191', '48bc771b-3438-4bdc-8df5-4ab2c5cc651a', 'd65e58f1-97d6-4d0a-aa59-ebed821c052c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9087e165-81ff-40e9-8854-c196b93efe3b tempest-GroupSnapshotsTest-1743352231 None] group_snapshot dde91c2b-99e7-4477-b8da-bca42684294b: created successfully Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:45 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:45 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:45 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG cinder.manager [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Deleted volume successfully. Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-592e261b-7272-4c6a-a575-797f0149925a req-18be1a75-4bd0-45f1-87fc-7b7d48d8c194 tempest-VolumesGetTestJSON-1666319860 None] Lock "cinder-ae442317-6f79-40f0-adc8-1c8cf32f9a38-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Flow 'volume_create_manager' (4ad1ba00-f2b2-436e-9d5e-bcecdc271a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9bbe1b-fe8d-404e-b863-3fe99cea0350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9bbe1b-fe8d-404e-b863-3fe99cea0350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1250728105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bd522f-88a7-400e-9f47-36c07e502a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5fe9c364de47e5971216d52eafcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:46Z,use_quota=True,user_id='dd6fb55526914fe4a1894f4d2a7cfc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f48941-289c-4066-a74e-8b5dcc05400b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f48941-289c-4066-a74e-8b5dcc05400b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f8cb48-4666-4421-9a54-e7ae8120630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f8cb48-4666-4421-9a54-e7ae8120630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20bd522f-88a7-400e-9f47-36c07e502a7b', 'volume_name': 'volume-20bd522f-88a7-400e-9f47-36c07e502a7b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf4a027-b250-4576-a2a2-d6f1459d715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf4a027-b250-4576-a2a2-d6f1459d715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b013c2db-c84e-4aac-9264-713ab9a9603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Volume 20bd522f-88a7-400e-9f47-36c07e502a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20bd522f-88a7-400e-9f47-36c07e502a7b', 'volume_size': 1} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1250728105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bd522f-88a7-400e-9f47-36c07e502a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5fe9c364de47e5971216d52eafcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:46Z,use_quota=True,user_id='dd6fb55526914fe4a1894f4d2a7cfc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Creating volume 20bd522f-88a7-400e-9f47-36c07e502a7b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:46 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:46 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b 1073741824 Sep 02 00:47:46 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:46 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b 1073741824" returned: 0 in 0.679s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:46 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b Sep 02 00:47:46 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:47 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.648s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-fbef09ad-c185-4fd6-b4e9-0fe798863c68-b34c670a-9f10-4998-bb6d-7ddd01c864a1" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b013c2db-c84e-4aac-9264-713ab9a9603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bd522f-88a7-400e-9f47-36c07e502a7b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb642a39-8770-49b5-a26a-70601743110c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-fbef09ad-c185-4fd6-b4e9-0fe798863c68-b34c670a-9f10-4998-bb6d-7ddd01c864a1" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Creating volume b34c670a-9f10-4998-bb6d-7ddd01c864a1 from snapshot fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-b34c670a-9f10-4998-bb6d-7ddd01c864a1" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Volume volume-20bd522f-88a7-400e-9f47-36c07e502a7b (20bd522f-88a7-400e-9f47-36c07e502a7b): created successfully Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb642a39-8770-49b5-a26a-70601743110c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Flow 'volume_create_manager' (4ad1ba00-f2b2-436e-9d5e-bcecdc271a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-b34c670a-9f10-4998-bb6d-7ddd01c864a1" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] snapshot: fbef09ad-c185-4fd6-b4e9-0fe798863c68, volume: b34c670a-9f10-4998-bb6d-7ddd01c864a1, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:47:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-deb4f5ef-ad42-4917-b7e3-0d411a575b45 tempest-VolumesTransfersV357Test-1797583710 None] Created volume successfully. Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad268bf3-f8ad-4211-bf15-d3a69a3ebde3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:47 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 Sep 02 00:47:47 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:47 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd3cda-465e-4929-9e80-8e07d5daa42c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:47 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f Sep 02 00:47:47 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:48 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" returned: 0 in 0.611s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:47:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:47:48 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:47:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:48 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 Sep 02 00:47:48 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9a363325-c01b-4579-b6fc-6515a2f0ee6f tempest-VolumesTransfersV357Test-1149325205 None] Transfer volume completed successfully. Sep 02 00:47:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a97d8442-2254-47c0-a053-9a6061369497 tempest-BackendsCapabilitiesAdminTestsJSON-180157461 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9354515075684, 'free_capacity_gb': 1773.9354515075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 00:47:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-404b6e9c-cb95-4f61-a2da-f01bdbaf3ee2 tempest-BackendsCapabilitiesAdminTestsJSON-180157461 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9354515075684, 'free_capacity_gb': 1773.9354515075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 00:47:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Acquiring lock "cinder-20bd522f-88a7-400e-9f47-36c07e502a7b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-20bd522f-88a7-400e-9f47-36c07e502a7b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Acquiring lock "cinder-quobyte-20bd522f-88a7-400e-9f47-36c07e502a7b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-quobyte-20bd522f-88a7-400e-9f47-36c07e502a7b" acquired by "delete_volume" :: waited 0.052s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ef720-30f9-4a94-bf4a-54b8f5f4a105]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:52 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b Sep 02 00:47:52 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:53 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b" returned: 0 in 0.781s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:53 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b Sep 02 00:47:53 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:54 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20bd522f-88a7-400e-9f47-36c07e502a7b" returned: 0 in 0.918s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-quobyte-20bd522f-88a7-400e-9f47-36c07e502a7b" released by "delete_volume" :: held 1.823s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Created reservations ['72f8620c-56dc-4bd0-b635-f536a1af9921', 'd4061f39-88ca-46c7-9d29-8a495bccbbe3', '7ddabc62-280b-4b00-8cdd-15fbaf3ace76', 'e6587291-837b-4d35-947e-ed164718e47b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:54 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:54 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:54 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1" returned: 0 in 6.662s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:47:55 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Converted 1024.00 MB image at 153.64 MB/s Sep 02 00:47:55 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:55 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 Sep 02 00:47:55 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:55 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.546s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Deleted volume successfully. Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5e1965c0-243a-4523-899b-0cc05f5bb10d tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-20bd522f-88a7-400e-9f47-36c07e502a7b-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:55 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1" returned: 0 in 0.313s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-b34c670a-9f10-4998-bb6d-7ddd01c864a1" released by "_copy_volume_from_snapshot" :: held 8.086s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-fbef09ad-c185-4fd6-b4e9-0fe798863c68-b34c670a-9f10-4998-bb6d-7ddd01c864a1" released by "_create_volume_from_snapshot" :: held 8.171s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.206s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f0dd8aff-cce9-43a1-a2c0-d13aa074c1e8 tempest-GroupSnapshotsTest-1743352231 None] Create group from source-snapshot-dde91c2b-99e7-4477-b8da-bca42684294b completed successfully. Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-b34c670a-9f10-4998-bb6d-7ddd01c864a1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-b34c670a-9f10-4998-bb6d-7ddd01c864a1" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d6a9b2-0405-4992-97cc-07dee021f301]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Flow 'volume_create_manager' (22c95de2-b96f-43c2-a75a-053eb81306e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322128a5-5724-4722-9973-b232bae5d0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322128a5-5724-4722-9973-b232bae5d0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1222543625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdfdffa-70cf-4a13-b82b-9d977379668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5fe9c364de47e5971216d52eafcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:56Z,use_quota=True,user_id='dd6fb55526914fe4a1894f4d2a7cfc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd14cca2-2c71-451d-ad88-3ea957c54a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd14cca2-2c71-451d-ad88-3ea957c54a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a830a133-04f7-4193-98c4-92d6f6b57281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a830a133-04f7-4193-98c4-92d6f6b57281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdfdffa-70cf-4a13-b82b-9d977379668e', 'volume_name': 'volume-1fdfdffa-70cf-4a13-b82b-9d977379668e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:56 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 Sep 02 00:47:56 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0818163c-8449-425e-9ba6-a7ada43f4ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0818163c-8449-425e-9ba6-a7ada43f4ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac501b-c7b9-45ff-8375-52fedd1599cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Volume 1fdfdffa-70cf-4a13-b82b-9d977379668e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdfdffa-70cf-4a13-b82b-9d977379668e', 'volume_size': 1} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1222543625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdfdffa-70cf-4a13-b82b-9d977379668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5fe9c364de47e5971216d52eafcdec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:47:56Z,use_quota=True,user_id='dd6fb55526914fe4a1894f4d2a7cfc89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Creating volume 1fdfdffa-70cf-4a13-b82b-9d977379668e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:47:56 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:56 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e 1073741824 Sep 02 00:47:56 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:56 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1" returned: 0 in 0.494s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:56 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1 Sep 02 00:47:56 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:57 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e 1073741824" returned: 0 in 0.580s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:57 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b34c670a-9f10-4998-bb6d-7ddd01c864a1" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:57 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e Sep 02 00:47:57 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-b34c670a-9f10-4998-bb6d-7ddd01c864a1" released by "delete_volume" :: held 0.942s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['92aa6103-7c49-4d71-a816-b1813974de96'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:57 devstack cinder-volume[87232]: WARNING cinder.quota [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1654924020 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1654924020, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:47:57 devstack cinder-volume[87232]: WARNING cinder.quota [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1654924020 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1654924020, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['e819f29c-9af8-4cd8-9c3f-283a85d056df', '311d064f-bbd1-4923-a534-972f9252c7e7', 'ad7fedfd-9a95-4be0-959d-ca4aad729e42', '9b837161-02e2-40bb-bf81-9d23575782cf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:47:57 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:47:57 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:47:57 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ac501b-c7b9-45ff-8375-52fedd1599cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdfdffa-70cf-4a13-b82b-9d977379668e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43295978-e723-410a-b845-87dbc7af5bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:47:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Volume volume-1fdfdffa-70cf-4a13-b82b-9d977379668e (1fdfdffa-70cf-4a13-b82b-9d977379668e): created successfully Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43295978-e723-410a-b845-87dbc7af5bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Flow 'volume_create_manager' (22c95de2-b96f-43c2-a75a-053eb81306e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:47:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-061c1dad-cf4e-4e26-b5f2-1037876bf74c tempest-VolumesTransfersV357Test-1797583710 None] Created volume successfully. Sep 02 00:47:57 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:57 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:47:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-94566ecb-3de8-4110-a41d-68f73d245005 tempest-GroupSnapshotsTest-1743352231 None] Delete group completed successfully. Sep 02 00:47:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] group_snapshot dde91c2b-99e7-4477-b8da-bca42684294b: deleting Sep 02 00:47:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] group_snapshot dde91c2b-99e7-4477-b8da-bca42684294b: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 00:47:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-fbef09ad-c185-4fd6-b4e9-0fe798863c68" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-fbef09ad-c185-4fd6-b4e9-0fe798863c68" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Deleting offline snapshot fbef09ad-c185-4fd6-b4e9-0fe798863c68 of volume 5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] snapshot_file for this snap is: volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4886fb0c-79c4-47f5-83c1-e67ca8346766]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Acquiring lock "cinder-1fdfdffa-70cf-4a13-b82b-9d977379668e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-1fdfdffa-70cf-4a13-b82b-9d977379668e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Acquiring lock "cinder-quobyte-1fdfdffa-70cf-4a13-b82b-9d977379668e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-quobyte-1fdfdffa-70cf-4a13-b82b-9d977379668e" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c3bfb8-bf7d-4a98-bf66-71bbaee96b10]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:59 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 Sep 02 00:47:59 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:59 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e Sep 02 00:47:59 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:59 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff430d2c-bc64-475e-a2a1-5d15d5ea7baf]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:59 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e" returned: 0 in 0.468s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:47:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:47:59 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e Sep 02 00:47:59 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:47:59 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f Sep 02 00:47:59 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:00 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1fdfdffa-70cf-4a13-b82b-9d977379668e" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-quobyte-1fdfdffa-70cf-4a13-b82b-9d977379668e" released by "delete_volume" :: held 0.831s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Created reservations ['4cd6b791-3fb7-47e2-880e-e4f293e31613', 'fbf0b65b-9f22-4f69-b18a-c18ad9144443', 'c43c2845-922d-420e-a4b1-f6e7d87c46e3', '2d48c1c5-dca5-4703-a849-79685a186919'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:00 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" returned: 0 in 0.711s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:00 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:00 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:00 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 Sep 02 00:48:00 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:00 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Deleted volume successfully. Sep 02 00:48:00 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68" returned: 0 in 0.440s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793300ee-2dad-42c9-bffa-6a93f6068fea tempest-VolumesTransfersV357Test-1473800638 None] Lock "cinder-1fdfdffa-70cf-4a13-b82b-9d977379668e-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:00 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68 Sep 02 00:48:00 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:01 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f.fbef09ad-c185-4fd6-b4e9-0fe798863c68" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-fbef09ad-c185-4fd6-b4e9-0fe798863c68" released by "_delete_snapshot" :: held 2.108s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" released by "delete_snapshot" :: held 2.142s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:01 devstack cinder-volume[87232]: WARNING cinder.quota [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1654924020 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1654924020, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['5c4ff2c2-12ed-4a5c-97fa-4aa8486cdd96', '8ac8eae5-0763-4eab-8b1c-b4137e4cf332', '943840d3-752d-4b72-b2d2-38aff96c0d14', '85168120-087b-4f8d-8535-061e84a73d69'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-489abb5b-d43c-4446-882c-3b8408f142d7 tempest-GroupSnapshotsTest-1743352231 None] group_snapshot dde91c2b-99e7-4477-b8da-bca42684294b: deleted successfully Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5033a762-0a7c-4661-b3c2-98273a7f620f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:02 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f Sep 02 00:48:02 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:02 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:02 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f Sep 02 00:48:02 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:02 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-5ffbc67a-4c8f-4d3a-bf8c-20163474440f" released by "delete_volume" :: held 1.004s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['6ff035e7-f722-4aa5-8194-2fb08d7bffeb'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:02 devstack cinder-volume[87232]: WARNING cinder.db.api [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1654924020'] Sep 02 00:48:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['f214f058-9749-4f87-8e2e-11c2cc9aa9d1', '3f23953b-9bcb-4433-962f-a1ae80010ba7', 'ea30d58f-2d2c-4c49-9ac7-f5c0d60495ca', '75ead910-6185-491d-9ae2-9518e540df9b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:03 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:03 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:03 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cbc1f6e9-57e9-43d1-8dd2-6c4df3aee1fa tempest-GroupSnapshotsTest-1743352231 None] Delete group completed successfully. Sep 02 00:48:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-77a064e0-8200-41a0-97cf-80c4afe4402f tempest-GroupSnapshotsTest-1743352231 None] Group tempest-GroupSnapshotsTest-Group-1832020239: creating Sep 02 00:48:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-77a064e0-8200-41a0-97cf-80c4afe4402f tempest-GroupSnapshotsTest-1743352231 None] Group tempest-GroupSnapshotsTest-Group-1832020239: created successfully Sep 02 00:48:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-77a064e0-8200-41a0-97cf-80c4afe4402f tempest-GroupSnapshotsTest-1743352231 None] Create group completed successfully. Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (038f9e4d-f35c-4619-8943-86dd92748398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b730c738-4b32-4fc9-81a5-bf9e5285ca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b730c738-4b32-4fc9-81a5-bf9e5285ca3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-620483443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87496c8e-733e-48a5-b91a-f8fa92eabfe4,host='devstack@QuobyteHD#QuobyteHD',id=da69dc6a-6b18-46bb-b83a-6785c1404083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:07Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bd386a9-53cc-4db6-9dee-a135bc36a15e),volume_type_id=0bd386a9-53cc-4db6-9dee-a135bc36a15e)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ffce8-35e8-45b5-9d1f-a7a447939bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ffce8-35e8-45b5-9d1f-a7a447939bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b44d7-b7a9-4dad-8614-12b3a23459da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b44d7-b7a9-4dad-8614-12b3a23459da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da69dc6a-6b18-46bb-b83a-6785c1404083', 'volume_name': 'volume-da69dc6a-6b18-46bb-b83a-6785c1404083', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bb05fa-7187-43c5-afbd-298b3ec698ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bb05fa-7187-43c5-afbd-298b3ec698ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08ac3b6-4f92-4025-b76b-d2510968ef76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Volume da69dc6a-6b18-46bb-b83a-6785c1404083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da69dc6a-6b18-46bb-b83a-6785c1404083', 'volume_size': 1} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=87496c8e-733e-48a5-b91a-f8fa92eabfe4,created_at=2026-09-01T22:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-620483443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87496c8e-733e-48a5-b91a-f8fa92eabfe4,host='devstack@QuobyteHD#QuobyteHD',id=da69dc6a-6b18-46bb-b83a-6785c1404083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:07Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bd386a9-53cc-4db6-9dee-a135bc36a15e),volume_type_id=0bd386a9-53cc-4db6-9dee-a135bc36a15e)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Creating volume da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:06 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:06 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 1073741824 Sep 02 00:48:06 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:07 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 1073741824" returned: 0 in 0.839s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:07 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 Sep 02 00:48:07 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Flow 'volume_create_manager' (4b50bf13-ca0c-410b-9878-2bf7e65703d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:08 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8f756c-a0f6-45de-9970-d4bd5ab67c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083" returned: 0 in 0.556s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08ac3b6-4f92-4025-b76b-d2510968ef76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da69dc6a-6b18-46bb-b83a-6785c1404083', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2393951c-bb4e-447d-a5de-dbc1f85296ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8f756c-a0f6-45de-9970-d4bd5ab67c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1879178962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d05c89-aef8-45a5-8d17-1c77c3ad7004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b94b24b2d79485587ccd3bd43230eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:08Z,use_quota=True,user_id='768f50a5a823423b8daa9004b2d3091e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f922c2a-ae10-42a4-a80d-5756053554fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f922c2a-ae10-42a4-a80d-5756053554fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa04224-039e-4662-9d1c-59be81efcedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa04224-039e-4662-9d1c-59be81efcedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d05c89-aef8-45a5-8d17-1c77c3ad7004', 'volume_name': 'volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc12eaca-6e63-46c0-8f82-8e69bdc78345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc12eaca-6e63-46c0-8f82-8e69bdc78345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da32aeea-a3ec-4718-9474-2f937846bc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Volume 80d05c89-aef8-45a5-8d17-1c77c3ad7004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004', 'volume_size': 1} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1879178962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d05c89-aef8-45a5-8d17-1c77c3ad7004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b94b24b2d79485587ccd3bd43230eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:08Z,use_quota=True,user_id='768f50a5a823423b8daa9004b2d3091e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Creating volume 80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8b8a113c-9ec2-4315-af0c-f8de6c84aa5a tempest-GroupsV314Test-170290215 None] Group tempest-GroupsV314Test-Group-539665509: creating Sep 02 00:48:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Volume volume-da69dc6a-6b18-46bb-b83a-6785c1404083 (da69dc6a-6b18-46bb-b83a-6785c1404083): created successfully Sep 02 00:48:08 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 1073741824 Sep 02 00:48:08 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2393951c-bb4e-447d-a5de-dbc1f85296ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (038f9e4d-f35c-4619-8943-86dd92748398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d79b12e5-9891-4305-b954-c26bc4a0dec0 tempest-GroupSnapshotsTest-1743352231 None] Created volume successfully. Sep 02 00:48:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8b8a113c-9ec2-4315-af0c-f8de6c84aa5a tempest-GroupsV314Test-170290215 None] Group tempest-GroupsV314Test-Group-539665509: created successfully Sep 02 00:48:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8b8a113c-9ec2-4315-af0c-f8de6c84aa5a tempest-GroupsV314Test-170290215 None] Create group completed successfully. Sep 02 00:48:09 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 1073741824" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:09 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 Sep 02 00:48:09 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:09 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da32aeea-a3ec-4718-9474-2f937846bc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f34333-9b72-48c2-8251-abbfab5c7419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Volume volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 (80d05c89-aef8-45a5-8d17-1c77c3ad7004): created successfully Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f34333-9b72-48c2-8251-abbfab5c7419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Flow 'volume_create_manager' (4b50bf13-ca0c-410b-9878-2bf7e65703d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5e917c00-6c54-4e20-8724-ffda7cb5e065 tempest-VolumesCloneTest-1919428424 None] Created volume successfully. Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (2b98d9d3-68bd-40d1-b41c-0d4f116695a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7ce330-e816-47f5-8985-1f7ed198500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7ce330-e816-47f5-8985-1f7ed198500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1935684994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87496c8e-733e-48a5-b91a-f8fa92eabfe4,host='devstack@QuobyteHD#QuobyteHD',id=26380992-2b7d-452d-ba08-17c9d4a42baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:10Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bd386a9-53cc-4db6-9dee-a135bc36a15e),volume_type_id=0bd386a9-53cc-4db6-9dee-a135bc36a15e)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0bcfaa-f2e4-48c6-a172-6e627874bb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0bcfaa-f2e4-48c6-a172-6e627874bb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9027716d-dcab-498e-b389-fb7fea738b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9027716d-dcab-498e-b389-fb7fea738b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26380992-2b7d-452d-ba08-17c9d4a42baa', 'volume_name': 'volume-26380992-2b7d-452d-ba08-17c9d4a42baa', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee61e8-bd5c-4f4a-adb2-cf2f20ab67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee61e8-bd5c-4f4a-adb2-cf2f20ab67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7988a0a-17fc-4a29-b171-ebac2dc624d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Volume 26380992-2b7d-452d-ba08-17c9d4a42baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26380992-2b7d-452d-ba08-17c9d4a42baa', 'volume_size': 1} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=87496c8e-733e-48a5-b91a-f8fa92eabfe4,created_at=2026-09-01T22:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1935684994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87496c8e-733e-48a5-b91a-f8fa92eabfe4,host='devstack@QuobyteHD#QuobyteHD',id=26380992-2b7d-452d-ba08-17c9d4a42baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:10Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bd386a9-53cc-4db6-9dee-a135bc36a15e),volume_type_id=0bd386a9-53cc-4db6-9dee-a135bc36a15e)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Creating volume 26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:10 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:10 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa 1073741824 Sep 02 00:48:10 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Flow 'volume_create_manager' (204bd72e-bced-412d-a7c7-80e73d219c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa49be37-aa49-465f-8027-642c226f4a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa49be37-aa49-465f-8027-642c226f4a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1469768783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ebdf9380-e57d-4027-8940-185d30d44dfc,host='devstack@QuobyteHD#QuobyteHD',id=5c7bef0c-a9a4-4ab1-83a9-115f0637380c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c51e9378d44101a621bde6c0712618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:10Z,use_quota=True,user_id='d408d2e9f54141289874fed73f6fba5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b12015-71df-4c42-b2fa-aa7f3ed082db),volume_type_id=52b12015-71df-4c42-b2fa-aa7f3ed082db)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb3a492-40f6-475b-b2c2-7bd302450652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb3a492-40f6-475b-b2c2-7bd302450652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b65cea-4e94-4e1b-a630-0bc1d5bc4b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b65cea-4e94-4e1b-a630-0bc1d5bc4b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7bef0c-a9a4-4ab1-83a9-115f0637380c', 'volume_name': 'volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73bd17b-20fe-4499-81c3-65c580e82a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73bd17b-20fe-4499-81c3-65c580e82a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aba7215-4241-4f99-8795-a2b3ef7d6a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Volume 5c7bef0c-a9a4-4ab1-83a9-115f0637380c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c', 'volume_size': 1} Sep 02 00:48:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:11 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa 1073741824" returned: 0 in 0.928s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:11 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa Sep 02 00:48:11 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:11 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Flow 'volume_create_manager' (ec7b57b4-8bc5-4c45-8a60-c47afa163046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b0fb1b-5ad8-4ac9-ab7b-5ea20b514830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b0fb1b-5ad8-4ac9-ab7b-5ea20b514830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-569924415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac22352f-937b-4c94-91ba-1cd991e3e765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b94b24b2d79485587ccd3bd43230eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=80d05c89-aef8-45a5-8d17-1c77c3ad7004,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:12Z,use_quota=True,user_id='768f50a5a823423b8daa9004b2d3091e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09578d4-928b-4e26-b833-8de5ce8d9d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09578d4-928b-4e26-b833-8de5ce8d9d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1981e4-6229-4847-9225-e0eba7873ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1981e4-6229-4847-9225-e0eba7873ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ac22352f-937b-4c94-91ba-1cd991e3e765', 'volume_name': 'volume-ac22352f-937b-4c94-91ba-1cd991e3e765', 'volume_size': 2, 'source_volid': '80d05c89-aef8-45a5-8d17-1c77c3ad7004', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:12 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd38356-78a9-4214-811b-3d705a388773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd38356-78a9-4214-811b-3d705a388773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81502ed9-bf96-426d-ab14-3640daeaeae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Volume ac22352f-937b-4c94-91ba-1cd991e3e765: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ac22352f-937b-4c94-91ba-1cd991e3e765', 'volume_size': 2, 'source_volid': '80d05c89-aef8-45a5-8d17-1c77c3ad7004', 'source_volstatus': 'available'} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa" returned: 0 in 0.684s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.518s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ebdf9380-e57d-4027-8940-185d30d44dfc,created_at=2026-09-01T22:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1469768783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ebdf9380-e57d-4027-8940-185d30d44dfc,host='devstack@QuobyteHD#QuobyteHD',id=5c7bef0c-a9a4-4ab1-83a9-115f0637380c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c51e9378d44101a621bde6c0712618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:10Z,use_quota=True,user_id='d408d2e9f54141289874fed73f6fba5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52b12015-71df-4c42-b2fa-aa7f3ed082db),volume_type_id=52b12015-71df-4c42-b2fa-aa7f3ed082db)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Creating volume 5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:12 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:12 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:12 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7988a0a-17fc-4a29-b171-ebac2dc624d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26380992-2b7d-452d-ba08-17c9d4a42baa', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb66920-539f-42ba-994d-fa78b67713db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:12 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c 1073741824 Sep 02 00:48:12 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Volume volume-26380992-2b7d-452d-ba08-17c9d4a42baa (26380992-2b7d-452d-ba08-17c9d4a42baa): created successfully Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb66920-539f-42ba-994d-fa78b67713db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (2b98d9d3-68bd-40d1-b41c-0d4f116695a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-088ae9d4-a963-4ff0-a3dd-4e38a0674a99 tempest-GroupSnapshotsTest-1743352231 None] Created volume successfully. Sep 02 00:48:12 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:48:12 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c 1073741824" returned: 0 in 0.746s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:13 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c Sep 02 00:48:13 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6fab8936-d92c-4920-817b-78db11b49cc8 tempest-GroupSnapshotsTest-1743352231 None] Update group completed successfully. Sep 02 00:48:13 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.126s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:13 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Cloning volume 80d05c89-aef8-45a5-8d17-1c77c3ad7004 to volume ac22352f-937b-4c94-91ba-1cd991e3e765 Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aba7215-4241-4f99-8795-a2b3ef7d6a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798f5d7-c9de-4f9f-9ce5-41d7daf01889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Volume volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c (5c7bef0c-a9a4-4ab1-83a9-115f0637380c): created successfully Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d798f5d7-c9de-4f9f-9ce5-41d7daf01889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Flow 'volume_create_manager' (204bd72e-bced-412d-a7c7-80e73d219c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Creating offline snapshot 2826a4ea-f66b-4bad-81d0-6d9571c203e8 of volume 80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:48:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ee1a06d4-252a-4018-934b-7c8816ffa7db tempest-GroupsV314Test-170290215 None] Created volume successfully. Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a509c-19c4-4ffa-82c9-78566b33664c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:13 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 Sep 02 00:48:13 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:13 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:13 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 1G Sep 02 00:48:13 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=152,cinder:UPDATE=179,cinder:INSERT=45,cinder:DELETE=16 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:48:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=150,cinder:UPDATE=187,cinder:INSERT=42,cinder:DELETE=10 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:48:14 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 1G" returned: 0 in 0.614s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bcfd8e9e-e73a-4958-98b2-ed3a6448d68c tempest-GroupSnapshotsTest-1743352231 None] Update group completed successfully. Sep 02 00:48:14 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 Sep 02 00:48:14 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:14 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8" returned: 0 in 0.412s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:14 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 is being set with open permissions: ugo+rw Sep 02 00:48:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:14 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 Sep 02 00:48:14 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:15 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:15 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.info Sep 02 00:48:15 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:15 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.info" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:15 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.info is being set with open permissions: ugo+rw Sep 02 00:48:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:15 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.info Sep 02 00:48:15 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-22f0ddfc-af1f-43c9-86d0-edad56358732 tempest-GroupSnapshotsTest-1743352231 None] Update group completed successfully. Sep 02 00:48:16 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.info" returned: 0 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "cinder-quobyte-ac22352f-937b-4c94-91ba-1cd991e3e765" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-ac22352f-937b-4c94-91ba-1cd991e3e765" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] snapshot: 2826a4ea-f66b-4bad-81d0-6d9571c203e8, volume: ac22352f-937b-4c94-91ba-1cd991e3e765, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Flow 'volume_create_manager' (32a5abcb-34d7-4ade-a30c-b2e83771fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48eb09d4-5a60-44bf-9c8d-aeb8447075b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f774bea5-4ef0-41b3-91cb-f690b8f7f8cd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48eb09d4-5a60-44bf-9c8d-aeb8447075b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1316271238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10175f0-afdf-4930-99ee-29f6fab02018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86712a0a882d487eb48b11f5ab9b1403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:16Z,use_quota=True,user_id='f63b565488a747ba87dc622d0daba3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f638432-e62a-4a6f-8540-f72da50c922e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f638432-e62a-4a6f-8540-f72da50c922e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865668e4-8025-448c-9212-8c7d809ddd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865668e4-8025-448c-9212-8c7d809ddd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10175f0-afdf-4930-99ee-29f6fab02018', 'volume_name': 'volume-b10175f0-afdf-4930-99ee-29f6fab02018', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4ab4dc-731f-417a-96e8-05bc692064ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4ab4dc-731f-417a-96e8-05bc692064ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec48bf9-4044-4935-ae78-60bbabcc6af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Volume b10175f0-afdf-4930-99ee-29f6fab02018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10175f0-afdf-4930-99ee-29f6fab02018', 'volume_size': 1} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:16 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 Sep 02 00:48:16 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:16 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[39276e08-2553-4f29-a1d3-ac146af6941d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:16 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 Sep 02 00:48:16 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:16 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:48:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:16 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 Sep 02 00:48:16 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ffda3ec2-89e3-434b-b435-e6c4ed786eb4 tempest-GroupSnapshotsTest-1743352231 None] Update group completed successfully. Sep 02 00:48:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] GroupSnapshot 19c3a174-19e6-4799-b5f0-1a112be7d6bd: creating. Sep 02 00:48:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Group snapshot 19c3a174-19e6-4799-b5f0-1a112be7d6bd: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 00:48:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:23 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765" returned: 0 in 6.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:48:23 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Converted 1024.00 MB image at 163.72 MB/s Sep 02 00:48:23 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 is being set with open permissions: ugo+rw Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:23 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 Sep 02 00:48:23 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:23 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765" returned: 0 in 0.252s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-ac22352f-937b-4c94-91ba-1cd991e3e765" released by "_copy_volume_from_snapshot" :: held 7.409s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "cinder-quobyte-2826a4ea-f66b-4bad-81d0-6d9571c203e8" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-2826a4ea-f66b-4bad-81d0-6d9571c203e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Deleting offline snapshot 2826a4ea-f66b-4bad-81d0-6d9571c203e8 of volume 80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] snapshot_file for this snap is: volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f2d0b-b9da-45e6-bd59-4c135d02083e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:23 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 Sep 02 00:48:23 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:23 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72634da-e912-4a6c-86ae-ee2cde13c95c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:24 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 Sep 02 00:48:24 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:24 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004" returned: 0 in 0.569s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:24 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 Sep 02 00:48:24 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:24 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:24 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8 Sep 02 00:48:24 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:25 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004.2826a4ea-f66b-4bad-81d0-6d9571c203e8" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-2826a4ea-f66b-4bad-81d0-6d9571c203e8" released by "_delete_snapshot" :: held 1.662s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.878s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.977s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:25 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Cloning volume 5c7bef0c-a9a4-4ab1-83a9-115f0637380c to volume 4104bed2-3fc0-4a72-8c89-c46fe264395f Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81502ed9-bf96-426d-ab14-3640daeaeae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac22352f-937b-4c94-91ba-1cd991e3e765', 'volume_size': 2, 'source_volid': '80d05c89-aef8-45a5-8d17-1c77c3ad7004', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96df36f-626e-4a44-83c9-580e68350fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Volume volume-ac22352f-937b-4c94-91ba-1cd991e3e765 (ac22352f-937b-4c94-91ba-1cd991e3e765): created successfully Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96df36f-626e-4a44-83c9-580e68350fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Flow 'volume_create_manager' (ec7b57b4-8bc5-4c45-8a60-c47afa163046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Creating offline snapshot e5ba06db-92a0-468c-9155-2aacb60560b0 of volume 5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:48:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4d59bf1b-f47c-4172-a5a4-0cd41f36f3b0 tempest-VolumesCloneTest-1919428424 None] Created volume successfully. Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f919d5-1c32-4b87-97eb-294b9ed68723]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:25 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c Sep 02 00:48:25 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:25 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:25 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 1G Sep 02 00:48:25 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "cinder-ac22352f-937b-4c94-91ba-1cd991e3e765-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-ac22352f-937b-4c94-91ba-1cd991e3e765-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "cinder-quobyte-ac22352f-937b-4c94-91ba-1cd991e3e765" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-ac22352f-937b-4c94-91ba-1cd991e3e765" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f6832f-844a-4c04-bbcd-0d662f087229]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:26 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 1G" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:26 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 Sep 02 00:48:26 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:26 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 Sep 02 00:48:26 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:26 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:26 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765 Sep 02 00:48:26 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:26 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0" returned: 0 in 0.329s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:26 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:26 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 Sep 02 00:48:26 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:26 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ac22352f-937b-4c94-91ba-1cd991e3e765" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-ac22352f-937b-4c94-91ba-1cd991e3e765" released by "delete_volume" :: held 0.696s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:26 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Created reservations ['b9373e28-4943-4073-95f8-0a2d92db6c4e', 'd6f3068e-e678-4381-abee-fa315528e120', '183daac0-ee21-4280-897f-afef566fdf17', '7919a23d-5b71-42f0-83d4-c9a17806bb6a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:26 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.info Sep 02 00:48:26 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:26 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:26 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:27 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.info" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:27 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:27 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:27 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.info Sep 02 00:48:27 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Deleted volume successfully. Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03447251-6451-43dd-aeb8-d544acdee304 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-ac22352f-937b-4c94-91ba-1cd991e3e765-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "cinder-80d05c89-aef8-45a5-8d17-1c77c3ad7004-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-80d05c89-aef8-45a5-8d17-1c77c3ad7004-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "cinder-quobyte-80d05c89-aef8-45a5-8d17-1c77c3ad7004" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-80d05c89-aef8-45a5-8d17-1c77c3ad7004" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d806ff1-f220-4090-9f46-339d2342f09e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:27 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.info" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Acquiring lock "cinder-quobyte-4104bed2-3fc0-4a72-8c89-c46fe264395f" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-4104bed2-3fc0-4a72-8c89-c46fe264395f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] snapshot: e5ba06db-92a0-468c-9155-2aacb60560b0, volume: 4104bed2-3fc0-4a72-8c89-c46fe264395f, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:27 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 Sep 02 00:48:27 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[589f4397-8f8c-4292-899d-42590e107c5b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:27 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 Sep 02 00:48:27 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:27 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:27 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004 Sep 02 00:48:27 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:27 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0" returned: 0 in 0.425s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa4211d-420e-4a4f-b6e0-ca0fbde3f314]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:28 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-80d05c89-aef8-45a5-8d17-1c77c3ad7004" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:28 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c Sep 02 00:48:28 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-quobyte-80d05c89-aef8-45a5-8d17-1c77c3ad7004" released by "delete_volume" :: held 0.764s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Created reservations ['f03a02d8-99ea-4bbe-a45e-7e3bebd12265', '9c1228ce-62d0-4f94-b02b-4e7f9561ae7c', '9e7bc786-10c4-4785-a931-a72cb2c06361', 'b9cd24fe-988b-46c1-827f-009a0bcc024c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:28 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:28 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:28 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:28 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f Sep 02 00:48:28 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:28 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Deleted volume successfully. Sep 02 00:48:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38694ca8-8158-4254-bec2-b315470401e1 tempest-VolumesCloneTest-1919428424 None] Lock "cinder-80d05c89-aef8-45a5-8d17-1c77c3ad7004-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:33 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f" returned: 0 in 5.569s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:33 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:48:33 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Converted 1024.00 MB image at 183.85 MB/s Sep 02 00:48:33 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:33 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f Sep 02 00:48:33 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:34 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-4104bed2-3fc0-4a72-8c89-c46fe264395f" released by "_copy_volume_from_snapshot" :: held 6.763s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Acquiring lock "cinder-quobyte-e5ba06db-92a0-468c-9155-2aacb60560b0" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-e5ba06db-92a0-468c-9155-2aacb60560b0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Deleting offline snapshot e5ba06db-92a0-468c-9155-2aacb60560b0 of volume 5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] snapshot_file for this snap is: volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4224030f-158d-4866-abbc-6e1f30637d2f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:34 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 Sep 02 00:48:34 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:34 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df9d9c0-00b2-440d-9256-bac4d92d8828]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Flow 'volume_create_manager' (43fd6a5c-76d1-42f5-a411-e4f6143a28f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e6108f-a3c0-4fa6-91d4-58002d77622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e6108f-a3c0-4fa6-91d4-58002d77622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1005255139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da70d5ed-7576-4ac2-9838-a452b6243650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfd8e1d9cb64d0abd61c243d9e72bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:35Z,use_quota=True,user_id='fd56e59eed9e45a9bb1e7e4bc9f055b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08525d8-f717-4540-8e20-9eb9a652f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08525d8-f717-4540-8e20-9eb9a652f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe64acf1-b737-4ab3-b237-5edf0fd1a680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:48:34 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c Sep 02 00:48:34 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe64acf1-b737-4ab3-b237-5edf0fd1a680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da70d5ed-7576-4ac2-9838-a452b6243650', 'volume_name': 'volume-da70d5ed-7576-4ac2-9838-a452b6243650', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e65816d-134f-4255-891f-df2660e2c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e65816d-134f-4255-891f-df2660e2c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529d8fa1-ee5d-4633-b761-353b98db1da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Volume da70d5ed-7576-4ac2-9838-a452b6243650: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da70d5ed-7576-4ac2-9838-a452b6243650', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:48:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Trying to clone da70d5ed-7576-4ac2-9838-a452b6243650 from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:48:35 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" returned: 0 in 0.590s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:35 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 Sep 02 00:48:35 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:48:35 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec3705b-56cf-4eb7-b2ef-9e4baaf80c83]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:35 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD Sep 02 00:48:35 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:35 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:35 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0 Sep 02 00:48:35 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:35 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 is fetched for user fd56e59eed9e45a9bb1e7e4bc9f055b2. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78798ff-46b0-4de2-9aec-d841d2f7a40a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:35 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c.e5ba06db-92a0-468c-9155-2aacb60560b0" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-e5ba06db-92a0-468c-9155-2aacb60560b0" released by "_delete_snapshot" :: held 1.653s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:35 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD Sep 02 00:48:35 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.686s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.699s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1316271238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10175f0-afdf-4930-99ee-29f6fab02018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86712a0a882d487eb48b11f5ab9b1403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:16Z,use_quota=True,user_id='f63b565488a747ba87dc622d0daba3fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Creating volume b10175f0-afdf-4930-99ee-29f6fab02018 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:35 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:35 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 1073741824 Sep 02 00:48:35 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3a1c3f4a-5a7a-45b1-ab75-074f0a6016a7 tempest-GroupsV314Test-170290215 None] Create group from source-group-ebdf9380-e57d-4027-8940-185d30d44dfc completed successfully. Sep 02 00:48:36 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:36 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 1073741824" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:36 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 Sep 02 00:48:36 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Acquiring lock "cinder-quobyte-4104bed2-3fc0-4a72-8c89-c46fe264395f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-4104bed2-3fc0-4a72-8c89-c46fe264395f" acquired by "delete_volume" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa35ba59-7f35-40aa-a8ce-e494d4a73db6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:36 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f Sep 02 00:48:36 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:36 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018" returned: 0 in 0.281s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.688s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Creating offline snapshot 3d1de981-a330-48fb-a9a3-268a260c3b23 of volume 26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec48bf9-4044-4935-ae78-60bbabcc6af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10175f0-afdf-4930-99ee-29f6fab02018', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1fd9c0-2984-41e6-a7c6-3d092107301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deeadc3-36d6-4b4f-8551-b9396656094e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Volume volume-b10175f0-afdf-4930-99ee-29f6fab02018 (b10175f0-afdf-4930-99ee-29f6fab02018): created successfully Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1fd9c0-2984-41e6-a7c6-3d092107301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Flow 'volume_create_manager' (32a5abcb-34d7-4ade-a30c-b2e83771fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-624a4a6a-dac0-4953-96d3-45f0b0f78dd2 tempest-TestMinimumBasicScenario-1628463372 None] Created volume successfully. Sep 02 00:48:36 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa Sep 02 00:48:36 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:36 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:36 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f Sep 02 00:48:36 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:37 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:37 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 1G Sep 02 00:48:37 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:37 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4104bed2-3fc0-4a72-8c89-c46fe264395f" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-4104bed2-3fc0-4a72-8c89-c46fe264395f" released by "delete_volume" :: held 0.696s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Created reservations ['ffd8997a-7562-43c8-bbf1-df622c1b083e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:37 devstack cinder-volume[87232]: WARNING cinder.quota [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1267591980 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1267591980, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:48:37 devstack cinder-volume[87232]: WARNING cinder.quota [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1267591980 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1267591980, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Created reservations ['e50eb65d-12ae-44fa-b212-991e068d9b4c', '73e25dd7-f2a8-4cb2-a490-200d4c4f33f8', '31ca335d-5804-4416-b5f1-25a736a8457d', '0ff613b2-36ab-4120-9ca7-f7c3d369f68e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:37 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:37 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:37 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 1G" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26380992-2b7d-452d-ba08-17c9d4a42baa -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:37 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26380992-2b7d-452d-ba08-17c9d4a42baa -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 Sep 02 00:48:37 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:37 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.335s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-614b1568-d312-49d7-9b83-72db1e7c5bf1 tempest-GroupsV314Test-170290215 None] Delete group completed successfully. Sep 02 00:48:37 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26380992-2b7d-452d-ba08-17c9d4a42baa -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Acquiring lock "cinder-quobyte-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:38 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 Sep 02 00:48:38 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e2b08e-23f6-4490-8611-2fd67c14f2d1]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:38 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c Sep 02 00:48:38 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:38 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:38 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.info Sep 02 00:48:38 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:38 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:38 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c Sep 02 00:48:38 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:38 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.info" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:38 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:38 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.info Sep 02 00:48:38 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a39e79c0-90c5-4c3d-b1fe-99bb5ef10d68 req-020ae9fc-fe3e-46cd-87f5-8db8fd5f7988 tempest-TestMinimumBasicScenario-1628463372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:38 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Lock "cinder-quobyte-5c7bef0c-a9a4-4ab1-83a9-115f0637380c" released by "delete_volume" :: held 0.779s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:38 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.info" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Created reservations ['8fd7c106-95e1-4196-a079-86abcdff85db'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Creating offline snapshot 9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed of volume da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[691df0c7-c0a9-4be5-bb77-8004af6b2605]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Created reservations ['ed2685f7-b974-42dd-8759-d5b4c5c2ff71', '61117d55-c1c0-4291-93aa-d7febfebaefd', '041db52c-30c2-4480-8197-434409bc1404', '1889a838-8d29-4640-bf17-40bc14aac59d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:39 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 Sep 02 00:48:39 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:39 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:39 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:39 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.267s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:39 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2ef4e359-c08a-4f3c-b47f-afd55eda1dda tempest-GroupsV314Test-170290215 None] Delete group completed successfully. Sep 02 00:48:39 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed 1G Sep 02 00:48:39 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:39 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed 1G" returned: 0 in 0.433s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da69dc6a-6b18-46bb-b83a-6785c1404083 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:39 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da69dc6a-6b18-46bb-b83a-6785c1404083 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed Sep 02 00:48:39 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:40 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da69dc6a-6b18-46bb-b83a-6785c1404083 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:40 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:40 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed Sep 02 00:48:40 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:40 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" returned: 0 in 0.272s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:40 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.info Sep 02 00:48:40 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:40 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.info" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:40 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:40 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.info Sep 02 00:48:40 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:40 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.info" returned: 0 in 0.266s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a39e79c0-90c5-4c3d-b1fe-99bb5ef10d68 req-020ae9fc-fe3e-46cd-87f5-8db8fd5f7988 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.300s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a39e79c0-90c5-4c3d-b1fe-99bb5ef10d68 req-020ae9fc-fe3e-46cd-87f5-8db8fd5f7988 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.860s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1005255139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da70d5ed-7576-4ac2-9838-a452b6243650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfd8e1d9cb64d0abd61c243d9e72bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:35Z,use_quota=True,user_id='fd56e59eed9e45a9bb1e7e4bc9f055b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Creating volume da70d5ed-7576-4ac2-9838-a452b6243650 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:41 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:41 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 1073741824 Sep 02 00:48:41 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-a39e79c0-90c5-4c3d-b1fe-99bb5ef10d68 req-020ae9fc-fe3e-46cd-87f5-8db8fd5f7988 tempest-TestMinimumBasicScenario-1628463372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-b10175f0-afdf-4930-99ee-29f6fab02018', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f78e4163-82de-4c9f-8d22-aa1c76f56d54', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:48:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a39e79c0-90c5-4c3d-b1fe-99bb5ef10d68 req-020ae9fc-fe3e-46cd-87f5-8db8fd5f7988 tempest-TestMinimumBasicScenario-1628463372 None] attachment_update completed successfully. Sep 02 00:48:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2bb89019-bd7a-44da-955e-f52a2933065b tempest-GroupSnapshotsTest-1743352231 None] group_snapshot 19c3a174-19e6-4799-b5f0-1a112be7d6bd: created successfully Sep 02 00:48:41 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 1073741824" returned: 0 in 0.557s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:41 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 Sep 02 00:48:41 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] group_snapshot 19c3a174-19e6-4799-b5f0-1a112be7d6bd: deleting Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] group_snapshot 19c3a174-19e6-4799-b5f0-1a112be7d6bd: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-26380992-2b7d-452d-ba08-17c9d4a42baa" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-26380992-2b7d-452d-ba08-17c9d4a42baa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-3d1de981-a330-48fb-a9a3-268a260c3b23" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-3d1de981-a330-48fb-a9a3-268a260c3b23" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Deleting offline snapshot 3d1de981-a330-48fb-a9a3-268a260c3b23 of volume 26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] snapshot_file for this snap is: volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8c1381-26c8-4127-9647-cbc223fdb722]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:42 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650" returned: 0 in 0.431s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Attempting download of 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume da70d5ed-7576-4ac2-9838-a452b6243650. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:48:42 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 Sep 02 00:48:42 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[06343f3e-700c-4e80-aff9-e4005915cfd2]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_9ztox_ez {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:42 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_9ztox_ez Sep 02 00:48:42 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:42 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23" returned: 0 in 0.515s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26380992-2b7d-452d-ba08-17c9d4a42baa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fd6d69-248a-458e-84c2-c91ea0243965]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:42 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_9ztox_ez" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_9ztox_ez {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:42 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa Sep 02 00:48:42 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:42 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_9ztox_ez Sep 02 00:48:42 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:42 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_9ztox_ez" returned: 1 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_9ztox_ez' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[017aad95-8e70-4912-8f58-90508ca9f217]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:43 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:43 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 Sep 02 00:48:43 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:43 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD Sep 02 00:48:43 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:43 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] 55fd1d9e-80e7-4ee4-bf99-467853787b78 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:43 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 Sep 02 00:48:43 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:43 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23" returned: 0 in 0.465s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:43 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23 Sep 02 00:48:43 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:43 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa.3d1de981-a330-48fb-a9a3-268a260c3b23" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-3d1de981-a330-48fb-a9a3-268a260c3b23" released by "_delete_snapshot" :: held 1.877s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-26380992-2b7d-452d-ba08-17c9d4a42baa" released by "delete_snapshot" :: held 1.916s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-da69dc6a-6b18-46bb-b83a-6785c1404083" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-da69dc6a-6b18-46bb-b83a-6785c1404083" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Deleting offline snapshot 9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed of volume da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] snapshot_file for this snap is: volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[24834f32-4077-4cda-9289-aea1afa639fd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:44 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed Sep 02 00:48:44 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:44 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" returned: 0 in 0.520s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da69dc6a-6b18-46bb-b83a-6785c1404083(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:48:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b6e9d-c007-495d-ae23-76a20f53a4cd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:44 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 Sep 02 00:48:44 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:44 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:44 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed Sep 02 00:48:44 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:45 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" returned: 0 in 0.523s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:45 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed Sep 02 00:48:45 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:45 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650" returned: 0 in 2.238s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_taf4af8kdevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:48:45 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Converted 112.00 MB image at 50.02 MB/s Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:45 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 1G Sep 02 00:48:45 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:45 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083.9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-9db074d8-cdb6-44eb-b0ea-93b7bd2d32ed" released by "_delete_snapshot" :: held 1.978s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-da69dc6a-6b18-46bb-b83a-6785c1404083" released by "delete_snapshot" :: held 2.015s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:45 devstack cinder-volume[87232]: WARNING cinder.quota [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1114568394 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1114568394, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:48:45 devstack cinder-volume[87232]: WARNING cinder.quota [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1114568394 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1114568394, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['e3da308a-f85c-41dc-a4e5-a9415861e5b5', '9063448a-c6cb-4dfe-abb9-97b9b8804f70', '5d7ab362-210a-4a97-bcd9-f074f82030bb', 'f6746c2d-798f-40fb-b4f6-21d06e4cd409'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:46 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 1G" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Downloaded image 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume da70d5ed-7576-4ac2-9838-a452b6243650 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 for user fd56e59eed9e45a9bb1e7e4bc9f055b2 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Marking volume da70d5ed-7576-4ac2-9838-a452b6243650 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Copying metadata from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 to da70d5ed-7576-4ac2-9838-a452b6243650. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Creating volume glance metadata for volume da70d5ed-7576-4ac2-9838-a452b6243650 backed by image 55fd1d9e-80e7-4ee4-bf99-467853787b78 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['0de81e4b-268d-420b-b6be-fba4c41eac4c', '69ec14b4-ea8e-498d-a833-5ca400a771f9', 'fa384904-61a5-46f9-8386-6cd8a3b86b09', '75440221-c791-4791-8667-a0ea113e8564'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529d8fa1-ee5d-4633-b761-353b98db1da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da70d5ed-7576-4ac2-9838-a452b6243650', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99fcc1-262a-49d5-8c28-9b304e617701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Volume volume-da70d5ed-7576-4ac2-9838-a452b6243650 (da70d5ed-7576-4ac2-9838-a452b6243650): created successfully Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99fcc1-262a-49d5-8c28-9b304e617701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Flow 'volume_create_manager' (43fd6a5c-76d1-42f5-a411-e4f6143a28f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b3fa4313-2631-4740-895b-225c2157e945 tempest-VolumesExtendTest-1153808169 None] Created volume successfully. Sep 02 00:48:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-91ae6335-3671-4d1d-a87c-5347f18bcf57 tempest-GroupSnapshotsTest-1743352231 None] group_snapshot 19c3a174-19e6-4799-b5f0-1a112be7d6bd: deleted successfully Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aac91cf-99db-4759-bd65-93eef4dedfb9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:46 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 Sep 02 00:48:46 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-26380992-2b7d-452d-ba08-17c9d4a42baa" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-26380992-2b7d-452d-ba08-17c9d4a42baa" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddf0b3d-41c1-40dc-b1d4-8df1de1fe27f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:47 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa Sep 02 00:48:47 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:47 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650" returned: 0 in 0.631s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 2G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 2G" returned: 0 in 0.173s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.851s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9c52499b-2319-4e36-aea3-8c272588db02 tempest-VolumesExtendTest-1153808169 None] Extend volume completed successfully. Sep 02 00:48:47 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:47 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa Sep 02 00:48:47 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:48 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-26380992-2b7d-452d-ba08-17c9d4a42baa" returned: 0 in 0.360s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-26380992-2b7d-452d-ba08-17c9d4a42baa" released by "delete_volume" :: held 0.929s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-da69dc6a-6b18-46bb-b83a-6785c1404083" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "cinder-da70d5ed-7576-4ac2-9838-a452b6243650-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-da69dc6a-6b18-46bb-b83a-6785c1404083" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-da70d5ed-7576-4ac2-9838-a452b6243650-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f47936d-036c-4396-a862-d6817801057a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "cinder-quobyte-da70d5ed-7576-4ac2-9838-a452b6243650" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-da70d5ed-7576-4ac2-9838-a452b6243650" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[15638b33-1d28-4a65-aa2e-3e83199a5c85]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:48 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 Sep 02 00:48:48 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:48 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 Sep 02 00:48:48 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:48 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083" returned: 0 in 0.560s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:48 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083 Sep 02 00:48:48 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:48 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650" returned: 0 in 0.499s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:48 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650 Sep 02 00:48:48 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:49 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da69dc6a-6b18-46bb-b83a-6785c1404083" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-da69dc6a-6b18-46bb-b83a-6785c1404083" released by "delete_volume" :: held 1.039s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:49 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-da70d5ed-7576-4ac2-9838-a452b6243650" returned: 0 in 0.300s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-da70d5ed-7576-4ac2-9838-a452b6243650" released by "delete_volume" :: held 0.886s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['1131736f-af1d-4591-ac1f-5f5b24674fb5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Created reservations ['6f3699e3-9225-473e-85ba-82868a56fa38', '119feee4-0889-4525-a380-2ef5180e7ae4', '53215084-d692-4797-8697-ccb18897dd4a', '5d32b8a3-b3e8-4fff-9d96-8ee00d4af91b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:49 devstack cinder-volume[87232]: WARNING cinder.quota [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1114568394 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1114568394, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['bbd3ec60-b98a-4b56-95a6-a94762490365', '373e22c5-3df0-43d2-9177-55420d57fbc8', 'd85422af-652e-4477-a7af-67ffc76a6588', 'bb6324c8-4f1f-4589-adce-8a0b12c2a31a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:49 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:49 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['a7d09252-6230-4a1b-bacb-0cc75ab88318', '39930f39-bb8a-4714-81c9-3c7aee3a8618', '710f49e0-286b-42b1-b292-77614bfe03ce', 'f734b317-f1ca-410f-b9e2-650b2f1fd954'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:49 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Deleted volume successfully. Sep 02 00:48:49 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:48:49 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-41a48639-dfcc-4b96-8b43-4a478e6fc0e9 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-da70d5ed-7576-4ac2-9838-a452b6243650-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:48:50 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.327s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:50 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:48:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-22d37b31-fd3a-4757-9823-ae218eac9a08 tempest-GroupSnapshotsTest-1743352231 None] Delete group completed successfully. Sep 02 00:48:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-91e4f4f4-834b-48fd-833d-3397d159fa66 tempest-GroupSnapshotsTest-1743352231 None] Group tempest-GroupSnapshotsTest-Group-1562076218: creating Sep 02 00:48:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-91e4f4f4-834b-48fd-833d-3397d159fa66 tempest-GroupSnapshotsTest-1743352231 None] Group tempest-GroupSnapshotsTest-Group-1562076218: created successfully Sep 02 00:48:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-91e4f4f4-834b-48fd-833d-3397d159fa66 tempest-GroupSnapshotsTest-1743352231 None] Create group completed successfully. Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Flow 'volume_create_manager' (fb2c7d81-e003-4267-bc72-00fa4ffa9f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6f2b1-a7f2-4772-aea1-f23a6b14a4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e6f2b1-a7f2-4772-aea1-f23a6b14a4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-70274479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6084215d-7a46-4471-8246-f8dcd6cf7508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfd8e1d9cb64d0abd61c243d9e72bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:51Z,use_quota=True,user_id='fd56e59eed9e45a9bb1e7e4bc9f055b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722db6a1-bf73-4dd9-aa1c-61abda297770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722db6a1-bf73-4dd9-aa1c-61abda297770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aaaa87f-dff8-49bc-afc4-4b082661435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aaaa87f-dff8-49bc-afc4-4b082661435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6084215d-7a46-4471-8246-f8dcd6cf7508', 'volume_name': 'volume-6084215d-7a46-4471-8246-f8dcd6cf7508', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f092bee-c923-4ff0-86e8-d85febfc791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f092bee-c923-4ff0-86e8-d85febfc791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc122a15-dde0-4e05-85ad-30577558c3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Volume 6084215d-7a46-4471-8246-f8dcd6cf7508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6084215d-7a46-4471-8246-f8dcd6cf7508', 'volume_size': 1} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-70274479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6084215d-7a46-4471-8246-f8dcd6cf7508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfd8e1d9cb64d0abd61c243d9e72bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:51Z,use_quota=True,user_id='fd56e59eed9e45a9bb1e7e4bc9f055b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Creating volume 6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:51 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:51 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 1073741824 Sep 02 00:48:51 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:52 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 1073741824" returned: 0 in 0.578s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:52 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 Sep 02 00:48:52 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (f17412b8-1c71-482c-81e5-df4052b8aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc102c87-7eb1-41ce-beb9-a3ec7478f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc102c87-7eb1-41ce-beb9-a3ec7478f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084678919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a4f9386-1771-49be-8d82-377529923600,host='devstack@QuobyteHD#QuobyteHD',id=65186ced-a921-46f8-afc0-1328ba6d5674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:52Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9165248c-1db4-4a23-a1d6-0f3170d214f3),volume_type_id=9165248c-1db4-4a23-a1d6-0f3170d214f3)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f5b2a6-7ea5-4b50-8deb-64e7e1677d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f5b2a6-7ea5-4b50-8deb-64e7e1677d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fd2d66-2466-47b1-90a1-6c7d9e8d854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fd2d66-2466-47b1-90a1-6c7d9e8d854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65186ced-a921-46f8-afc0-1328ba6d5674', 'volume_name': 'volume-65186ced-a921-46f8-afc0-1328ba6d5674', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f9385-cc80-4e90-a05d-6e4eb9d52dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f9385-cc80-4e90-a05d-6e4eb9d52dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8307be34-4956-4fc4-aef4-745fe1e0b417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:52 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Volume 65186ced-a921-46f8-afc0-1328ba6d5674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65186ced-a921-46f8-afc0-1328ba6d5674', 'volume_size': 1} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:52 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508" returned: 0 in 0.443s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6a4f9386-1771-49be-8d82-377529923600,created_at=2026-09-01T22:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2084678919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a4f9386-1771-49be-8d82-377529923600,host='devstack@QuobyteHD#QuobyteHD',id=65186ced-a921-46f8-afc0-1328ba6d5674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7ddc2a971a4d09bd9c6cc41782c3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:48:52Z,use_quota=True,user_id='f0733f4cd3ad4d7fbc9c087087b223fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9165248c-1db4-4a23-a1d6-0f3170d214f3),volume_type_id=9165248c-1db4-4a23-a1d6-0f3170d214f3)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Creating volume 65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:48:52 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc122a15-dde0-4e05-85ad-30577558c3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6084215d-7a46-4471-8246-f8dcd6cf7508', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:52 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 1073741824 Sep 02 00:48:52 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b7a86d-2eb8-4515-81f8-99b7e6d78e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:52 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Volume volume-6084215d-7a46-4471-8246-f8dcd6cf7508 (6084215d-7a46-4471-8246-f8dcd6cf7508): created successfully Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b7a86d-2eb8-4515-81f8-99b7e6d78e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Flow 'volume_create_manager' (fb2c7d81-e003-4267-bc72-00fa4ffa9f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-19c55ee0-bee1-409b-913b-ee552aa60552 tempest-VolumesExtendTest-1153808169 None] Created volume successfully. Sep 02 00:48:53 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 1073741824" returned: 0 in 0.489s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:53 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 Sep 02 00:48:53 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:53 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674" returned: 0 in 0.266s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8307be34-4956-4fc4-aef4-745fe1e0b417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65186ced-a921-46f8-afc0-1328ba6d5674', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4678dac5-1d32-4d01-92d0-623d4a423944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:48:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Volume volume-65186ced-a921-46f8-afc0-1328ba6d5674 (65186ced-a921-46f8-afc0-1328ba6d5674): created successfully Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4678dac5-1d32-4d01-92d0-623d4a423944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Flow 'volume_create_manager' (f17412b8-1c71-482c-81e5-df4052b8aa00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:48:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dbe68a95-026f-47a2-985c-e17d8fd426f8 tempest-GroupSnapshotsTest-1743352231 None] Created volume successfully. Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Creating offline snapshot 508a9e49-c01f-44ab-b246-426a25108a40 of volume 6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[224052a7-ebe1-45ef-bc6c-83c7a641f72f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:53 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 Sep 02 00:48:53 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] GroupSnapshot cffb2ea8-9bfa-4b7a-8ac2-95f676996fdb: creating. Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Group snapshot cffb2ea8-9bfa-4b7a-8ac2-95f676996fdb: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 02 00:48:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:54 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:54 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 1G Sep 02 00:48:54 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:54 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 1G" returned: 0 in 0.430s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6084215d-7a46-4471-8246-f8dcd6cf7508 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:54 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6084215d-7a46-4471-8246-f8dcd6cf7508 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 Sep 02 00:48:54 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:54 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6084215d-7a46-4471-8246-f8dcd6cf7508 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:54 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 is being set with open permissions: ugo+rw Sep 02 00:48:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:54 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 Sep 02 00:48:54 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:55 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40" returned: 0 in 0.268s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:55 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.info Sep 02 00:48:55 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:55 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.info" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:55 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.info is being set with open permissions: ugo+rw Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:55 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.info Sep 02 00:48:55 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:55 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.info" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.919s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Creating offline snapshot 9dd42308-1e33-475e-a025-31084dd503d4 of volume 65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:48:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-faa82385-72b4-47eb-8d29-148d44c1c6cf tempest-VolumesExtendTest-1153808169 None] Create snapshot completed successfully Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3550115-50c1-4ab6-b0f2-bbd9b97a9a9c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:56 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 Sep 02 00:48:56 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:56 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:56 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 1G Sep 02 00:48:56 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:56 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 1G" returned: 0 in 0.497s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65186ced-a921-46f8-afc0-1328ba6d5674 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:56 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65186ced-a921-46f8-afc0-1328ba6d5674 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 Sep 02 00:48:56 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:48:57 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65186ced-a921-46f8-afc0-1328ba6d5674 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:57 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:57 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 Sep 02 00:48:57 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:57 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4" returned: 0 in 0.267s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:57 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.info Sep 02 00:48:57 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:57 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.info" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:57 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.info is being set with open permissions: ugo+rw: NotImplementedError Sep 02 00:48:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:57 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.info Sep 02 00:48:57 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:58 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.info" returned: 0 in 0.255s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.127s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.033s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7824c80-ea22-411a-9e03-0a087973f8b4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1b66b60d-5c99-4214-b559-bd9f61c06ae5 tempest-GroupSnapshotsTest-1743352231 None] group_snapshot cffb2ea8-9bfa-4b7a-8ac2-95f676996fdb: created successfully Sep 02 00:48:58 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 Sep 02 00:48:58 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] group_snapshot cffb2ea8-9bfa-4b7a-8ac2-95f676996fdb: deleting Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] group_snapshot cffb2ea8-9bfa-4b7a-8ac2-95f676996fdb: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-65186ced-a921-46f8-afc0-1328ba6d5674" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-65186ced-a921-46f8-afc0-1328ba6d5674" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-9dd42308-1e33-475e-a025-31084dd503d4" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-9dd42308-1e33-475e-a025-31084dd503d4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:58 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Deleting offline snapshot 9dd42308-1e33-475e-a025-31084dd503d4 of volume 65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] snapshot_file for this snap is: volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508" returned: 0 in 0.507s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 2G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad5b0f-8b85-407e-9a9b-47fb60f17edc]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:58 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 Sep 02 00:48:58 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 2G" returned: 0 in 0.193s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.748s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:48:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6e8f1f75-e42f-4b64-b952-5c9d0b81130d tempest-VolumesExtendTest-1153808169 None] Extend volume completed successfully. Sep 02 00:48:59 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65186ced-a921-46f8-afc0-1328ba6d5674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2cc70-bb81-42f2-9728-badfd316d060]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:59 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 Sep 02 00:48:59 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "cinder-508a9e49-c01f-44ab-b246-426a25108a40-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-508a9e49-c01f-44ab-b246-426a25108a40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "cinder-quobyte-6084215d-7a46-4471-8246-f8dcd6cf7508" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-6084215d-7a46-4471-8246-f8dcd6cf7508" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Acquiring lock "cinder-quobyte-508a9e49-c01f-44ab-b246-426a25108a40" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-508a9e49-c01f-44ab-b246-426a25108a40" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Deleting offline snapshot 508a9e49-c01f-44ab-b246-426a25108a40 of volume 6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] snapshot_file for this snap is: volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d8573f-f5e0-418f-b7df-b117930bec8e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:59 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674" returned: 0 in 0.584s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:48:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:48:59 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 Sep 02 00:48:59 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:48:59 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 Sep 02 00:48:59 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:00 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40" returned: 0 in 0.462s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6084215d-7a46-4471-8246-f8dcd6cf7508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc9a99c-aa24-417d-a10f-d3baa29d3bfd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:00 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:00 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4 Sep 02 00:49:00 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:00 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 Sep 02 00:49:00 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:00 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Flow 'volume_create_manager' (d4037d4e-3474-4ced-936c-4c2a6e72f0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5daddd54-4ad6-4c21-bb00-c927dcea54ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674.9dd42308-1e33-475e-a025-31084dd503d4" returned: 0 in 0.501s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-9dd42308-1e33-475e-a025-31084dd503d4" released by "_delete_snapshot" :: held 2.143s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5daddd54-4ad6-4c21-bb00-c927dcea54ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-56601285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87af86c4-6df4-48ec-81e6-7bd526f3ce90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e86dccd40b641b2b604ac7f2306d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:01Z,use_quota=True,user_id='501780eb2fd04799925988622170029a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5866d6f3-c6f9-4499-b18c-ed56599adaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5866d6f3-c6f9-4499-b18c-ed56599adaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33f559c-7e6b-4d7e-b296-eab38fd9f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33f559c-7e6b-4d7e-b296-eab38fd9f86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87af86c4-6df4-48ec-81e6-7bd526f3ce90', 'volume_name': 'volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a9b427-9e4b-4b93-b087-62ae4a31554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a9b427-9e4b-4b93-b087-62ae4a31554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d097ab-379b-4ab0-9943-786abde9d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Volume 87af86c4-6df4-48ec-81e6-7bd526f3ce90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90', 'volume_size': 1} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-56601285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87af86c4-6df4-48ec-81e6-7bd526f3ce90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e86dccd40b641b2b604ac7f2306d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:01Z,use_quota=True,user_id='501780eb2fd04799925988622170029a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Creating volume 87af86c4-6df4-48ec-81e6-7bd526f3ce90 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:00 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:00 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-65186ced-a921-46f8-afc0-1328ba6d5674" released by "delete_snapshot" :: held 2.247s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508" returned: 0 in 0.705s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:00 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 1073741824 Sep 02 00:49:00 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:00 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 Sep 02 00:49:00 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:00 devstack cinder-volume[87232]: WARNING cinder.quota [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1065513878 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1065513878, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:49:00 devstack cinder-volume[87232]: WARNING cinder.quota [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1065513878 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1065513878, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:49:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['9a550ece-6a7b-4f55-8a3a-f93fcaeb82c5', '899c3a4b-f018-4ae4-b785-5b3141ac02a0', '7fa2127b-4fc2-41df-b496-7d5db5d67378', '6fb69f30-882f-4404-b3f1-a282d8cc4139'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fc582cf2-76da-41c3-8696-bcb390d1fd0c tempest-GroupSnapshotsTest-1743352231 None] group_snapshot cffb2ea8-9bfa-4b7a-8ac2-95f676996fdb: deleted successfully Sep 02 00:49:01 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40" returned: 0 in 0.471s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:01 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40 Sep 02 00:49:01 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:01 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 1073741824" returned: 0 in 0.592s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:01 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 Sep 02 00:49:01 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:01 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508.508a9e49-c01f-44ab-b246-426a25108a40" returned: 0 in 0.329s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-508a9e49-c01f-44ab-b246-426a25108a40" released by "_delete_snapshot" :: held 2.137s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-6084215d-7a46-4471-8246-f8dcd6cf7508" released by "delete_snapshot" :: held 2.166s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Created reservations ['061fee37-e76e-4243-a5e3-bb2573294ae5', 'bf47a70d-eb46-4210-aeb1-83bc532e5131', '89bc94d6-6913-425f-845e-9db5ebcb1a7f', '5a027ef1-5123-4802-86f0-e6e017f0b601'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:01 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90" returned: 0 in 0.293s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d097ab-379b-4ab0-9943-786abde9d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ef5da8-ccd3-4f3c-9306-690e43c43c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Volume volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 (87af86c4-6df4-48ec-81e6-7bd526f3ce90): created successfully Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ef5da8-ccd3-4f3c-9306-690e43c43c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Flow 'volume_create_manager' (d4037d4e-3474-4ced-936c-4c2a6e72f0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4e8d2b42-73cd-49b6-ba41-90c3aaabc4ff tempest-VolumeQuotasAdminTestJSON-1695106245 None] Created volume successfully. Sep 02 00:49:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Delete snapshot completed successfully. Sep 02 00:49:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3130f0ba-e22e-4b7f-b900-b875e749c069 tempest-VolumesExtendTest-1153808169 None] Lock "cinder-508a9e49-c01f-44ab-b246-426a25108a40-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "cinder-quobyte-65186ced-a921-46f8-afc0-1328ba6d5674" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-65186ced-a921-46f8-afc0-1328ba6d5674" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9feac6-ae5e-4acf-a106-8c95d502a034]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:02 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 Sep 02 00:49:02 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:02 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:02 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674 Sep 02 00:49:02 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Acquiring lock "cinder-87af86c4-6df4-48ec-81e6-7bd526f3ce90-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "cinder-87af86c4-6df4-48ec-81e6-7bd526f3ce90-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Acquiring lock "cinder-quobyte-87af86c4-6df4-48ec-81e6-7bd526f3ce90" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "cinder-quobyte-87af86c4-6df4-48ec-81e6-7bd526f3ce90" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Acquiring lock "cinder-6084215d-7a46-4471-8246-f8dcd6cf7508-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd91598-a1b5-449f-9d84-c3719de55d1d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Lock "cinder-6084215d-7a46-4471-8246-f8dcd6cf7508-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Acquiring lock "cinder-quobyte-6084215d-7a46-4471-8246-f8dcd6cf7508" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-6084215d-7a46-4471-8246-f8dcd6cf7508" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:03 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 Sep 02 00:49:03 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9631b778-68f3-4688-9921-64d337570534]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:03 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65186ced-a921-46f8-afc0-1328ba6d5674" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Lock "cinder-quobyte-65186ced-a921-46f8-afc0-1328ba6d5674" released by "delete_volume" :: held 0.873s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['a7e4d742-f0c9-46a0-a409-1329dc570f71'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:03 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 Sep 02 00:49:03 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:03 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1065513878 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1065513878, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Created reservations ['9c59b1d4-c3e2-4e6d-aabe-9698402edb01', '16b2aff6-d4c9-49aa-b3a1-2859574fe465', '341ef5c4-16c5-48da-b09a-b0c31a7e095d', 'e9d8bbd4-2103-41ba-b235-71293d2ad5e5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:03 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90" returned: 0 in 0.447s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:03 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90 Sep 02 00:49:03 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:03 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:49:03 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:03 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508" returned: 0 in 0.518s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:03 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508 Sep 02 00:49:03 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:03 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-87af86c4-6df4-48ec-81e6-7bd526f3ce90" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "cinder-quobyte-87af86c4-6df4-48ec-81e6-7bd526f3ce90" released by "delete_volume" :: held 0.878s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:03 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:49:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4f528bf9-aac0-4bc1-8ac2-69c59d0dcc14 tempest-GroupSnapshotsTest-1743352231 None] Delete group completed successfully. Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Created reservations ['f9588172-48b8-4cf7-b007-6158acee0440', '726da6c5-77be-4adc-8710-c4a338d2515a', '41c91a80-f01b-4e49-990b-1779090ba436', '5e17d996-d8c3-4dc5-b37c-c7cca04f5ae6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:03 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6084215d-7a46-4471-8246-f8dcd6cf7508" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:03 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:49:03 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Lock "cinder-quobyte-6084215d-7a46-4471-8246-f8dcd6cf7508" released by "delete_volume" :: held 0.919s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Created reservations ['20b3bc6f-a549-45de-8750-ac47dd8be96b', '3eb1a8a1-be54-4da5-97eb-8918b841439e', '5ea085de-d371-485c-8b06-78b0fdf6978e', 'e8f3282a-55f7-4f7e-863d-53c32d74be07'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:04 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:49:04 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:04 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:49:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Deleted volume successfully. Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-970b2ce8-8a72-4e70-b461-c93a5fe5834d tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "cinder-87af86c4-6df4-48ec-81e6-7bd526f3ce90-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:04 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:49:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Deleted volume successfully. Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c76d41eb-e138-49b1-b249-05263dbfb4df tempest-VolumesExtendTest-1153808169 None] Lock "cinder-6084215d-7a46-4471-8246-f8dcd6cf7508-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Flow 'volume_create_manager' (4fc93d92-031d-4410-8bee-df6c11dbb99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43862b54-0bbd-4c7b-ab2d-8caee7712dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43862b54-0bbd-4c7b-ab2d-8caee7712dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1688998736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fcc06a-8e28-496f-a572-82511f6fdcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e86dccd40b641b2b604ac7f2306d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:05Z,use_quota=True,user_id='501780eb2fd04799925988622170029a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e074abfc-2c90-4b8c-8bf6-bbd93f8c25ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e074abfc-2c90-4b8c-8bf6-bbd93f8c25ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaaf7f4-6d21-4343-a9a9-289fd1026f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaaf7f4-6d21-4343-a9a9-289fd1026f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28fcc06a-8e28-496f-a572-82511f6fdcc1', 'volume_name': 'volume-28fcc06a-8e28-496f-a572-82511f6fdcc1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f3250a-6e0b-4848-b7bf-4b5148b67dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f3250a-6e0b-4848-b7bf-4b5148b67dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c0c416-6965-4d25-87e6-0756d5762d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Volume 28fcc06a-8e28-496f-a572-82511f6fdcc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28fcc06a-8e28-496f-a572-82511f6fdcc1', 'volume_size': 1} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1688998736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fcc06a-8e28-496f-a572-82511f6fdcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e86dccd40b641b2b604ac7f2306d205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:05Z,use_quota=True,user_id='501780eb2fd04799925988622170029a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Creating volume 28fcc06a-8e28-496f-a572-82511f6fdcc1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:04 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:04 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 1073741824 Sep 02 00:49:04 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:05 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 1073741824" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:05 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 Sep 02 00:49:05 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:05 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c0c416-6965-4d25-87e6-0756d5762d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fcc06a-8e28-496f-a572-82511f6fdcc1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bb1ab7-878f-4dc1-89b5-cbfcc4f2f0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Volume volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 (28fcc06a-8e28-496f-a572-82511f6fdcc1): created successfully Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bb1ab7-878f-4dc1-89b5-cbfcc4f2f0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Flow 'volume_create_manager' (4fc93d92-031d-4410-8bee-df6c11dbb99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-daf9829b-2394-44dd-9d88-4576ea06bd80 tempest-VolumeQuotasAdminTestJSON-1695106245 None] Created volume successfully. Sep 02 00:49:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-070ae5f9-8c74-4bfb-89c7-6806d7f7a1f4 tempest-VolumeQuotasAdminTestJSON-1757383787 None] Transfer volume completed successfully. Sep 02 00:49:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Acquiring lock "cinder-28fcc06a-8e28-496f-a572-82511f6fdcc1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Lock "cinder-28fcc06a-8e28-496f-a572-82511f6fdcc1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Acquiring lock "cinder-quobyte-28fcc06a-8e28-496f-a572-82511f6fdcc1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Lock "cinder-quobyte-28fcc06a-8e28-496f-a572-82511f6fdcc1" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e134d208-0ecb-4bc2-a9d3-851e5e5d8c4d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:08 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 Sep 02 00:49:08 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:09 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1" returned: 0 in 0.482s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:09 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1 Sep 02 00:49:09 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:09 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28fcc06a-8e28-496f-a572-82511f6fdcc1" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Lock "cinder-quobyte-28fcc06a-8e28-496f-a572-82511f6fdcc1" released by "delete_volume" :: held 0.985s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Created reservations ['7677c7f3-cf24-479c-9fed-6349906d14a3', '1c14b7bc-dbc6-4b36-92c1-8ca310378f64', '68483428-e1ed-47a7-8d0c-e5c57d4af7e5', 'ece2d811-7aad-47ab-8b6a-753a45c579b8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:09 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:49:09 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:10 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.472s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:49:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Deleted volume successfully. Sep 02 00:49:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39ac6771-5a1a-4707-92db-7860edc7f4ad tempest-VolumeQuotasAdminTestJSON-1480142850 None] Lock "cinder-28fcc06a-8e28-496f-a572-82511f6fdcc1-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:12 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:49:12 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:12 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.422s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:49:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:49:19 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=151,cinder:UPDATE=158,cinder:INSERT=44,cinder:DELETE=5 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:49:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=178,cinder:SELECT=158,cinder:INSERT=47,cinder:DELETE=9 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Flow 'volume_create_manager' (f627d91a-d96c-4db2-a54c-a501956608ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae3156a-335b-46f8-86aa-72fa75bc12f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae3156a-335b-46f8-86aa-72fa75bc12f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-799381536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b238f5d-4df5-4fd1-b3b1-610531edb4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1888157975a24e649d4d79e53698be15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:23Z,use_quota=True,user_id='42ca1562a4c54cda834967fb59880919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a8aa87-a276-4a8c-a02a-d13a86921da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a8aa87-a276-4a8c-a02a-d13a86921da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e257140-5f63-4e58-a832-b7e1e98fa277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e257140-5f63-4e58-a832-b7e1e98fa277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b238f5d-4df5-4fd1-b3b1-610531edb4ca', 'volume_name': 'volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ccfcdc-534c-4d4e-9243-b04f09054e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ccfcdc-534c-4d4e-9243-b04f09054e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a7448e-0ebd-40c7-ad48-5da6a397a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Volume 3b238f5d-4df5-4fd1-b3b1-610531edb4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca', 'volume_size': 1} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-799381536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b238f5d-4df5-4fd1-b3b1-610531edb4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1888157975a24e649d4d79e53698be15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:23Z,use_quota=True,user_id='42ca1562a4c54cda834967fb59880919',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Creating volume 3b238f5d-4df5-4fd1-b3b1-610531edb4ca {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:23 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca 1073741824 Sep 02 00:49:23 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:24 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca 1073741824" returned: 0 in 0.498s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:24 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca Sep 02 00:49:24 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:24 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a7448e-0ebd-40c7-ad48-5da6a397a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b722d14d-02f4-42db-af38-3ef71f120488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Volume volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca (3b238f5d-4df5-4fd1-b3b1-610531edb4ca): created successfully Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b722d14d-02f4-42db-af38-3ef71f120488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Flow 'volume_create_manager' (f627d91a-d96c-4db2-a54c-a501956608ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-956bcf7a-7fc8-47f4-b5a4-0f62b9178a7e tempest-VolumesServicesTestJSON-1885998106 None] Created volume successfully. Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Flow 'volume_create_manager' (5a02bf94-4884-4c60-9568-975d4709a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87bb460-2878-460a-a13e-d31b5f7891e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87bb460-2878-460a-a13e-d31b5f7891e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-454806553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2234b5f5-f0a5-4315-b1da-43e09aa96fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0821c3b8b8541ccaf131b4314e0f76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:25Z,use_quota=True,user_id='f2fbdac649a54ea2bcd2bf7153497c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832c0843-527e-45a3-a033-f567ca02e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832c0843-527e-45a3-a033-f567ca02e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e2f7f3-26da-476b-94f5-d2f335255f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e2f7f3-26da-476b-94f5-d2f335255f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2234b5f5-f0a5-4315-b1da-43e09aa96fea', 'volume_name': 'volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaa40c9-956e-4d2e-87de-27378cc3eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaa40c9-956e-4d2e-87de-27378cc3eacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e4451e-2010-4a12-ace3-980994c5bfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea', 'volume_size': 1} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-454806553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2234b5f5-f0a5-4315-b1da-43e09aa96fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0821c3b8b8541ccaf131b4314e0f76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:25Z,use_quota=True,user_id='f2fbdac649a54ea2bcd2bf7153497c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Creating volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:24 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:24 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea 1073741824 Sep 02 00:49:24 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:25 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea 1073741824" returned: 0 in 0.585s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:25 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea Sep 02 00:49:25 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Acquiring lock "cinder-3b238f5d-4df5-4fd1-b3b1-610531edb4ca-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:25 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e4451e-2010-4a12-ace3-980994c5bfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4e4cef-8832-4e9a-b5cf-5effed88e964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Lock "cinder-3b238f5d-4df5-4fd1-b3b1-610531edb4ca-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Volume volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea (2234b5f5-f0a5-4315-b1da-43e09aa96fea): created successfully Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4e4cef-8832-4e9a-b5cf-5effed88e964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Flow 'volume_create_manager' (5a02bf94-4884-4c60-9568-975d4709a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d3acefcd-1586-4559-b8f9-ba62800dc4c2 tempest-SnapshotsActionsTest-1921209722 None] Created volume successfully. Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Acquiring lock "cinder-quobyte-3b238f5d-4df5-4fd1-b3b1-610531edb4ca" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Lock "cinder-quobyte-3b238f5d-4df5-4fd1-b3b1-610531edb4ca" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[02589d5b-7eef-49fd-bff6-3d0916ec61b6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:26 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca Sep 02 00:49:26 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:26 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca" returned: 0 in 0.454s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:26 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca Sep 02 00:49:26 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:26 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3b238f5d-4df5-4fd1-b3b1-610531edb4ca" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Lock "cinder-quobyte-3b238f5d-4df5-4fd1-b3b1-610531edb4ca" released by "delete_volume" :: held 0.891s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Created reservations ['6033d4ce-1236-497e-acd2-f573748cb960', '0a42d3cd-b511-4fc4-a205-8d0dd2e8028b', '378f2403-ed90-403a-a553-ff980d9eee39', '17408099-60cd-477a-ba2c-7d900a33b81f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:27 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:49:27 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Creating offline snapshot 89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49fac7c-60cd-4f2b-a461-4a9c973418f5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:27 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:27 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea Sep 02 00:49:27 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:49:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Deleted volume successfully. Sep 02 00:49:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c75f031-0648-4980-9da3-3d2744d462ef tempest-VolumesServicesTestJSON-1885998106 None] Lock "cinder-3b238f5d-4df5-4fd1-b3b1-610531edb4ca-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:28 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea" returned: 0 in 0.823s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:28 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 1G Sep 02 00:49:28 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-3f97e247-f364-41db-9b0a-a0f76e8ee5c9 req-093259f7-65a5-41c0-88f6-aeb2c0762b0f tempest-TestMinimumBasicScenario-1628463372 None] Terminate volume connection completed successfully. Sep 02 00:49:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-3f97e247-f364-41db-9b0a-a0f76e8ee5c9 req-093259f7-65a5-41c0-88f6-aeb2c0762b0f tempest-TestMinimumBasicScenario-1628463372 None] Deleting attachment f78e4163-82de-4c9f-8d22-aa1c76f56d54. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:49:29 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 1G" returned: 0 in 0.711s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:29 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:29 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Acquiring lock "cinder-b10175f0-afdf-4930-99ee-29f6fab02018-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Lock "cinder-b10175f0-afdf-4930-99ee-29f6fab02018-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Acquiring lock "cinder-quobyte-b10175f0-afdf-4930-99ee-29f6fab02018" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Lock "cinder-quobyte-b10175f0-afdf-4930-99ee-29f6fab02018" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec6f727-0826-4f54-accd-3a46aef749b4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:29 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.458s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:29 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 is being set with open permissions: ugo+rw Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:29 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 Sep 02 00:49:29 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:29 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:29 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:29 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.343s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:29 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018" returned: 0 in 0.603s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:30 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.info Sep 02 00:49:30 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:30 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018 Sep 02 00:49:30 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:30 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.info" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:30 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.info is being set with open permissions: ugo+rw Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:30 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b10175f0-afdf-4930-99ee-29f6fab02018" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:30 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.info Sep 02 00:49:30 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Lock "cinder-quobyte-b10175f0-afdf-4930-99ee-29f6fab02018" released by "delete_volume" :: held 0.970s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Created reservations ['2b13b974-8597-479b-9861-b03a677111b8', 'aab5e877-83f0-4709-aac6-e4515de7f565', '14f996a4-1b73-448b-b58e-bfcc67053e4c', 'a92e4223-d128-4b54-9ceb-9dc523d73c36'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:30 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:49:30 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:30 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.info" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.161s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-187f7107-0fb0-4b69-a28a-f3c97a303828 tempest-SnapshotsActionsTest-1921209722 None] Create snapshot completed successfully Sep 02 00:49:30 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:49:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Deleted volume successfully. Sep 02 00:49:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6da502d4-39e4-4e31-b603-62e03cb08470 tempest-TestMinimumBasicScenario-1628463372 None] Lock "cinder-b10175f0-afdf-4930-99ee-29f6fab02018-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Creating offline snapshot e921c723-d7a8-4b98-b8de-b3dcba164164 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024a4cc-e66e-45ec-9288-bab50ee07723]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:33 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:33 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:33 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.535s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:33 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 1G Sep 02 00:49:33 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:34 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 1G" returned: 0 in 0.749s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:34 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 Sep 02 00:49:34 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:34 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:34 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 is being set with open permissions: ugo+rw Sep 02 00:49:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:34 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 Sep 02 00:49:34 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:35 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ce327fa4-b6ba-4aaa-961a-9073bef07d00 tempest-SnapshotsActionsTest-1921209722 None] Create snapshot completed successfully Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-e921c723-d7a8-4b98-b8de-b3dcba164164-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-e921c723-d7a8-4b98-b8de-b3dcba164164-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-e921c723-d7a8-4b98-b8de-b3dcba164164" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-e921c723-d7a8-4b98-b8de-b3dcba164164" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Deleting offline snapshot e921c723-d7a8-4b98-b8de-b3dcba164164 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] snapshot_file for this snap is: volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa50cdd-4260-42ee-8d1f-c08df9b549eb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:36 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 Sep 02 00:49:36 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:36 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae263711-18ff-45bf-89be-ca679581786b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:37 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:37 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:37 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.455s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:37 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 Sep 02 00:49:37 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:37 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164" returned: 0 in 0.430s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:37 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164 Sep 02 00:49:37 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:38 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.e921c723-d7a8-4b98-b8de-b3dcba164164" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-e921c723-d7a8-4b98-b8de-b3dcba164164" released by "_delete_snapshot" :: held 1.691s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" released by "delete_snapshot" :: held 1.723s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Created reservations ['7f757476-9060-4ebc-84f2-28a8455f0103', 'e0fcae30-aeca-43fb-a4b9-dbb1e6a03ce9', 'bf605298-f2ed-4c04-8304-1316fb548785', '4331e1e5-ab85-426a-8501-6e60066dbf27'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Delete snapshot completed successfully. Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a138f3-12f9-4b10-988c-43918c7d3e5e tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-e921c723-d7a8-4b98-b8de-b3dcba164164-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Creating offline snapshot 41fc5f58-da37-4fb5-956a-8730ca6c7626 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8037e-4c21-497e-8ba1-f4837e8f044e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:39 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:39 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:39 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:39 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 1G Sep 02 00:49:39 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:39 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 1G" returned: 0 in 0.674s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:40 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 Sep 02 00:49:40 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:40 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:40 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 is being set with open permissions: ugo+rw Sep 02 00:49:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:40 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 Sep 02 00:49:40 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:40 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-90039239-8320-45af-8e8d-8d9f27a6c830 tempest-SnapshotsActionsTest-1921209722 None] Create snapshot completed successfully Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-41fc5f58-da37-4fb5-956a-8730ca6c7626-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-41fc5f58-da37-4fb5-956a-8730ca6c7626-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-41fc5f58-da37-4fb5-956a-8730ca6c7626" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-41fc5f58-da37-4fb5-956a-8730ca6c7626" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Deleting offline snapshot 41fc5f58-da37-4fb5-956a-8730ca6c7626 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] snapshot_file for this snap is: volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cc94a9-943b-411c-9db6-ba4e50e67a14]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:42 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 Sep 02 00:49:42 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:42 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626" returned: 0 in 0.504s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd416017-47fd-4da8-afea-d1325db5b8e9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:43 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:43 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:43 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.600s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:43 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 Sep 02 00:49:43 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:44 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626" returned: 0 in 0.595s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:44 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626 Sep 02 00:49:44 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:44 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.41fc5f58-da37-4fb5-956a-8730ca6c7626" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-41fc5f58-da37-4fb5-956a-8730ca6c7626" released by "_delete_snapshot" :: held 2.146s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" released by "delete_snapshot" :: held 2.179s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Created reservations ['d5c53224-0ffc-4654-8297-d4ae343e6f77', '6137cab6-ba17-410a-88cd-20c50d61d139', '0701bb19-25dc-4488-80d9-5785dfdf14ee', 'e4c4ce16-a425-47ac-869f-52ed17b28bbc'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Delete snapshot completed successfully. Sep 02 00:49:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d52ea58-4de3-4b80-8705-6dc053646102 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-41fc5f58-da37-4fb5-956a-8730ca6c7626-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Creating offline snapshot 00b28b34-c28d-4c88-beca-fa7d3de543b0 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:49:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04b15d8-c11e-4125-9852-05e783d1597d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:46 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:46 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:46 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.510s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:46 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 1G Sep 02 00:49:46 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:46 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 1G" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:47 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 Sep 02 00:49:47 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:47 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:47 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 is being set with open permissions: ugo+rw Sep 02 00:49:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:47 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 Sep 02 00:49:47 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:48 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0" returned: 0 in 0.578s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-025bd44e-5ab4-4457-9620-b768078e495f tempest-SnapshotsActionsTest-1921209722 None] Create snapshot completed successfully Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-00b28b34-c28d-4c88-beca-fa7d3de543b0-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-00b28b34-c28d-4c88-beca-fa7d3de543b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-00b28b34-c28d-4c88-beca-fa7d3de543b0" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-00b28b34-c28d-4c88-beca-fa7d3de543b0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Deleting offline snapshot 00b28b34-c28d-4c88-beca-fa7d3de543b0 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] snapshot_file for this snap is: volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f58d83-649b-41e1-8824-45e146d4685c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:49 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 Sep 02 00:49:49 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:49 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0" returned: 0 in 0.570s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14066b3-f9d0-4ce9-b6a7-36de49ce091c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:50 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:50 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:50 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.544s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:50 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 Sep 02 00:49:50 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:51 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0" returned: 0 in 0.593s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:51 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0 Sep 02 00:49:51 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:51 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.00b28b34-c28d-4c88-beca-fa7d3de543b0" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-00b28b34-c28d-4c88-beca-fa7d3de543b0" released by "_delete_snapshot" :: held 2.223s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" released by "delete_snapshot" :: held 2.265s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Created reservations ['1f5dcfed-0689-4604-9d9b-c2e701916cf2', '51944bd2-1e8b-4f1b-92f2-fd4b6b20ece1', '85dfc47d-3dd0-47d5-a35d-cac1514b4422', 'b68c7e45-fee1-4d56-bc39-af0d2627c4fb'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Delete snapshot completed successfully. Sep 02 00:49:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cf1d6df9-e89f-4483-8472-b031888be7ee tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-00b28b34-c28d-4c88-beca-fa7d3de543b0-delete_snapshot" released by "delete_snapshot" :: held 2.544s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (b1709c66-bf45-49ac-b2be-7a60ccd71e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a130104-af2d-48f3-b226-b01e5771631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a130104-af2d-48f3-b226-b01e5771631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436543607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655bc2c5-877e-4125-8872-f26fe13afd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:53Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f88949-1597-4f63-90c5-b6d0fd4748b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f88949-1597-4f63-90c5-b6d0fd4748b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84383802-c0fe-4e7e-9ef9-0ab852a80ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84383802-c0fe-4e7e-9ef9-0ab852a80ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655bc2c5-877e-4125-8872-f26fe13afd96', 'volume_name': 'volume-655bc2c5-877e-4125-8872-f26fe13afd96', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea4db29-c052-4ac1-bf4f-f1f95a57f5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea4db29-c052-4ac1-bf4f-f1f95a57f5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2c4949-bfa4-4d4f-b0b9-47de9559806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:52 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Volume 655bc2c5-877e-4125-8872-f26fe13afd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655bc2c5-877e-4125-8872-f26fe13afd96', 'volume_size': 1} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436543607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655bc2c5-877e-4125-8872-f26fe13afd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:53Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Creating volume 655bc2c5-877e-4125-8872-f26fe13afd96 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:53 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:53 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 1073741824 Sep 02 00:49:53 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (3181cd9f-b59f-4c03-a08d-ea9815a93b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048f088e-11b5-4d1a-99d5-3751ef4820c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048f088e-11b5-4d1a-99d5-3751ef4820c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986629098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0361afb-04f0-4970-aec1-f8a022b3c677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:54Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd2f068-f441-48e2-856a-a490d04ffc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd2f068-f441-48e2-856a-a490d04ffc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6565b6f5-7ef1-480a-a26d-ce4c0add9688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6565b6f5-7ef1-480a-a26d-ce4c0add9688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0361afb-04f0-4970-aec1-f8a022b3c677', 'volume_name': 'volume-a0361afb-04f0-4970-aec1-f8a022b3c677', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d48c75d-71ca-43d6-a89b-0bb4c1d86f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d48c75d-71ca-43d6-a89b-0bb4c1d86f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41086a71-06ed-4bd7-a339-fe16bea4c4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Volume a0361afb-04f0-4970-aec1-f8a022b3c677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0361afb-04f0-4970-aec1-f8a022b3c677', 'volume_size': 1} Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:53 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 1073741824" returned: 0 in 0.915s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:54 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 Sep 02 00:49:54 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:54 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.338s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2c4949-bfa4-4d4f-b0b9-47de9559806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655bc2c5-877e-4125-8872-f26fe13afd96', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b110f89-355a-4b96-91d0-776de1633605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Volume volume-655bc2c5-877e-4125-8872-f26fe13afd96 (655bc2c5-877e-4125-8872-f26fe13afd96): created successfully Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b110f89-355a-4b96-91d0-776de1633605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (b1709c66-bf45-49ac-b2be-7a60ccd71e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Creating offline snapshot 5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:49:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1ce43948-7153-4f4b-ab36-b4362978c343 tempest-CreateVolumesFromImageTest-60059381 None] Created volume successfully. Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (8e1fc1d1-796a-4d25-acc5-8d299d07f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd87a20-c37e-4d79-81ef-01243c3287e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc4b632-ecf2-4d01-8243-d9f043363c78]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd87a20-c37e-4d79-81ef-01243c3287e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398776946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d56972-f8b7-4f6e-b6c6-03fe413090c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:54Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbe2f89-ecad-4d4a-a380-4e63d3b47cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbe2f89-ecad-4d4a-a380-4e63d3b47cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ecb8f4-cd2a-4d73-8b23-0ef17eb388b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ecb8f4-cd2a-4d73-8b23-0ef17eb388b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d56972-f8b7-4f6e-b6c6-03fe413090c2', 'volume_name': 'volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed334f-5b83-4c0f-bd3c-6febe0855205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed334f-5b83-4c0f-bd3c-6febe0855205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297b06b3-6b57-4b3a-b30b-eff0472621b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Volume a3d56972-f8b7-4f6e-b6c6-03fe413090c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2', 'volume_size': 1} Sep 02 00:49:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:54 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:54 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (586877a2-5674-48fd-949d-93d7410adb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db55deb-e82f-4b38-a3d7-253cbde243c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db55deb-e82f-4b38-a3d7-253cbde243c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1364146514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d6fa2b-588c-4524-bfce-a3a8fe449635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:55Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc128ecf-5935-4ed8-9548-af209bdb1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc128ecf-5935-4ed8-9548-af209bdb1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f561234-2ca9-499b-95bb-12e999279e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f561234-2ca9-499b-95bb-12e999279e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d6fa2b-588c-4524-bfce-a3a8fe449635', 'volume_name': 'volume-96d6fa2b-588c-4524-bfce-a3a8fe449635', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae39f5ab-f4a0-4573-94ec-7bdf8e524320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae39f5ab-f4a0-4573-94ec-7bdf8e524320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce86cbbb-c044-46be-8bd8-22ec5407846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Volume 96d6fa2b-588c-4524-bfce-a3a8fe449635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d6fa2b-588c-4524-bfce-a3a8fe449635', 'volume_size': 1} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:55 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.847s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:55 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 1G Sep 02 00:49:55 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (f5b024a8-47f9-49e1-bdf7-da75e99ed66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2800de08-a362-4636-8870-b82a606e5509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2800de08-a362-4636-8870-b82a606e5509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451932415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacc6d17-ab9f-4650-b3bc-8f747cc92abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:56Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3e99b0-9c62-407e-8f29-6998b3a9abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3e99b0-9c62-407e-8f29-6998b3a9abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3f3a4d-7bed-4dbb-86b0-b725c21c53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3f3a4d-7bed-4dbb-86b0-b725c21c53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dacc6d17-ab9f-4650-b3bc-8f747cc92abc', 'volume_name': 'volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ba4b1d-c524-474c-8550-704a323631a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ba4b1d-c524-474c-8550-704a323631a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea149e74-abdb-44e8-a8cc-74a4117cebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Volume dacc6d17-ab9f-4650-b3bc-8f747cc92abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc', 'volume_size': 1} Sep 02 00:49:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:56 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 1G" returned: 0 in 0.539s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:56 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 Sep 02 00:49:56 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Flow 'volume_create_manager' (13fea27f-abdb-4430-9c14-386b1e80cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d28def-5bba-4a87-a512-5fe4e8d53c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d28def-5bba-4a87-a512-5fe4e8d53c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1643766415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263b5be3-59c5-4884-bbc4-b4609e528c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7aeeb126e140a9a104c1181ef0a4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:56Z,use_quota=True,user_id='c462e809358841cba4cb1c74548a805d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd82d3f0-738f-4abb-b952-fb202d1e62c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd82d3f0-738f-4abb-b952-fb202d1e62c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0179ff-5247-4a04-83f2-c67374d8f5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:49:56 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" returned: 0 in 0.338s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:56 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 is being set with open permissions: ugo+rw Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:56 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 Sep 02 00:49:56 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0179ff-5247-4a04-83f2-c67374d8f5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '263b5be3-59c5-4884-bbc4-b4609e528c2a', 'volume_name': 'volume-263b5be3-59c5-4884-bbc4-b4609e528c2a', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2252bf1-3fed-4f40-b2f1-575b29a2fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2252bf1-3fed-4f40-b2f1-575b29a2fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879b9bce-ad74-40d9-9489-cb38a9f622ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Volume 263b5be3-59c5-4884-bbc4-b4609e528c2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-263b5be3-59c5-4884-bbc4-b4609e528c2a', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Trying to clone 263b5be3-59c5-4884-bbc4-b4609e528c2a from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:49:56 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.963s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986629098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0361afb-04f0-4970-aec1-f8a022b3c677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:54Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Creating volume a0361afb-04f0-4970-aec1-f8a022b3c677 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:56 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:56 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 1073741824 Sep 02 00:49:56 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-582fcd5a-e42a-423e-a11c-f5c188e4961a tempest-SnapshotsActionsTest-1921209722 None] Create snapshot completed successfully Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:49:57 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dd3514-dd52-48f5-a7c7-b3e2d102e202]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:57 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD Sep 02 00:49:57 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:57 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 1073741824" returned: 0 in 0.535s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:57 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 Sep 02 00:49:57 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:57 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 is fetched for user c462e809358841cba4cb1c74548a805d. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[64937b2a-a422-480d-81c5-174ea9ee2fab]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:57 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677" returned: 0 in 0.266s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.800s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:57 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398776946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d56972-f8b7-4f6e-b6c6-03fe413090c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:54Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:57 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Creating volume a3d56972-f8b7-4f6e-b6c6-03fe413090c2 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:57 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:57 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 1073741824 Sep 02 00:49:57 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41086a71-06ed-4bd7-a339-fe16bea4c4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0361afb-04f0-4970-aec1-f8a022b3c677', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8411b5d-8863-4b75-92ce-4350ced9a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Volume volume-a0361afb-04f0-4970-aec1-f8a022b3c677 (a0361afb-04f0-4970-aec1-f8a022b3c677): created successfully Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8411b5d-8863-4b75-92ce-4350ced9a559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (3181cd9f-b59f-4c03-a08d-ea9815a93b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-616d069c-1658-43d3-a7d5-6f8bf780007b tempest-CreateVolumesFromImageTest-60059381 None] Created volume successfully. Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Acquiring lock "cinder-quobyte-5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:49:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Deleting offline snapshot 5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] snapshot_file for this snap is: volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b6a7b4-cdce-4c61-ac42-67dba431d50b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:58 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:58 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 Sep 02 00:49:58 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:58 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 1073741824" returned: 0 in 0.636s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:58 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 Sep 02 00:49:58 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:58 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" returned: 0 in 0.450s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad0b106-3c43-42cf-9b39-48e050324d54]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:58 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.146s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1364146514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d6fa2b-588c-4524-bfce-a3a8fe449635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:55Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Creating volume 96d6fa2b-588c-4524-bfce-a3a8fe449635 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:58 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:58 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:49:58 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297b06b3-6b57-4b3a-b30b-eff0472621b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:58 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 1073741824 Sep 02 00:49:58 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff19a08-d3ae-4630-a2b8-076e0be85351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Volume volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 (a3d56972-f8b7-4f6e-b6c6-03fe413090c2): created successfully Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff19a08-d3ae-4630-a2b8-076e0be85351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (8e1fc1d1-796a-4d25-acc5-8d299d07f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0b844d86-db5a-4dbd-9a25-ed137d25244e tempest-CreateVolumesFromImageTest-60059381 None] Created volume successfully. Sep 02 00:49:58 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.450s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:49:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:59 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 Sep 02 00:49:59 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:59 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 1073741824" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:59 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 Sep 02 00:49:59 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:59 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" returned: 0 in 0.430s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:59 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635" returned: 0 in 0.273s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.520s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451932415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacc6d17-ab9f-4650-b3bc-8f747cc92abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0bf7cd1b5242db89354a994c8c5f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:56Z,use_quota=True,user_id='4b141f7e70764b2193917985b0963c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Creating volume dacc6d17-ab9f-4650-b3bc-8f747cc92abc {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:49:59 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818 Sep 02 00:49:59 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:49:59 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce86cbbb-c044-46be-8bd8-22ec5407846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d6fa2b-588c-4524-bfce-a3a8fe449635', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf2b2da-be38-4e93-ae55-a0944b1bbff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:49:59 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc 1073741824 Sep 02 00:49:59 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:49:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Volume volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 (96d6fa2b-588c-4524-bfce-a3a8fe449635): created successfully Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf2b2da-be38-4e93-ae55-a0944b1bbff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (586877a2-5674-48fd-949d-93d7410adb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:49:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6ab2f4d7-61e4-4a71-9f35-54cda1bf8092 tempest-CreateVolumesFromImageTest-60059381 None] Created volume successfully. Sep 02 00:49:59 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818" released by "_delete_snapshot" :: held 1.706s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" released by "delete_snapshot" :: held 1.742s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Created reservations ['e2f7c358-83a6-4594-b6b3-98327e08a730', '7d76b955-c4cf-43d3-bd8f-e1e335d487d8', 'b2be3c2c-2174-4d61-a8e3-9ffce42b56d7', 'e2a3234a-c6e1-4841-9cd2-55804a7e42b2'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:49:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Delete snapshot completed successfully. Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1ac8ff4f-2d89-46a7-984d-3e4a643e8c14 tempest-SnapshotsActionsTest-321776578 None] Lock "cinder-5e6e856c-b9ac-45f7-a3ee-5cbd0d9ff818-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:49:59 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc 1073741824" returned: 0 in 0.463s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:49:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:49:59 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc Sep 02 00:49:59 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:00 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.220s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1643766415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263b5be3-59c5-4884-bbc4-b4609e528c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7aeeb126e140a9a104c1181ef0a4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:49:56Z,use_quota=True,user_id='c462e809358841cba4cb1c74548a805d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Creating volume 263b5be3-59c5-4884-bbc4-b4609e528c2a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:00 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea149e74-abdb-44e8-a8cc-74a4117cebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef931c9a-49f8-4baa-b51d-33ef1e174fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:00 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a 1073741824 Sep 02 00:50:00 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Volume volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc (dacc6d17-ab9f-4650-b3bc-8f747cc92abc): created successfully Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef931c9a-49f8-4baa-b51d-33ef1e174fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Flow 'volume_create_manager' (f5b024a8-47f9-49e1-bdf7-da75e99ed66e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d0a1304c-3c83-496c-b733-5b76966e2dd0 tempest-CreateVolumesFromImageTest-60059381 None] Created volume successfully. Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "cinder-89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "cinder-quobyte-89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-quobyte-89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Deleting offline snapshot 89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 of volume 2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] snapshot_file for this snap is: volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c1ac7-8cc6-4e17-8287-11b67d1bbd48]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:00 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:50:00 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:00 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a 1073741824" returned: 0 in 0.556s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:00 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a Sep 02 00:50:00 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:01 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:01 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cd49ed-0e29-430d-a9fc-e43176a57cd6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Attempting download of 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume 263b5be3-59c5-4884-bbc4-b4609e528c2a. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da134a-5d35-47ed-88df-41b2e1903712]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78__p8b4uo4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:01 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea Sep 02 00:50:01 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:01 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78__p8b4uo4 Sep 02 00:50:01 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-dacc6d17-ab9f-4650-b3bc-8f747cc92abc-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-dacc6d17-ab9f-4650-b3bc-8f747cc92abc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-quobyte-dacc6d17-ab9f-4650-b3bc-8f747cc92abc" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-dacc6d17-ab9f-4650-b3bc-8f747cc92abc" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1a0c4-0fe9-4b87-9e4a-67c724c1fd1e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:01 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea" returned: 0 in 0.575s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:01 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc Sep 02 00:50:01 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:01 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:01 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78__p8b4uo4" returned: 0 in 0.481s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:01 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78__p8b4uo4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:01 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78__p8b4uo4 Sep 02 00:50:01 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:02 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:02 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc Sep 02 00:50:02 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:02 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.414s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:02 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78__p8b4uo4" returned: 1 in 0.380s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78__p8b4uo4' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bdf000-2705-4ae7-9ee6-c88e6b90ec91]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:02 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373 Sep 02 00:50:02 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:02 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD Sep 02 00:50:02 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:02 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dacc6d17-ab9f-4650-b3bc-8f747cc92abc" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-dacc6d17-ab9f-4650-b3bc-8f747cc92abc" released by "delete_volume" :: held 0.852s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:02 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea.89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-quobyte-89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373" released by "_delete_snapshot" :: held 1.825s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" released by "delete_snapshot" :: held 1.861s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:02 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] 55fd1d9e-80e7-4ee4-bf99-467853787b78 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Created reservations ['1b8c458e-de0a-4b1c-939b-8adb29467530', '19e836cc-d5f1-4c0c-a9a6-060da487d1ef', '6f169cf4-4f02-4d49-bf09-e64d06cef3c3', 'b2699460-3439-41dd-8756-c59d304da5c5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:02 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a Sep 02 00:50:02 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Created reservations ['0593c728-03d1-4501-834f-3ea371170838', '0a8b57ae-8e7b-4c05-949f-7959c9deadd7', 'bb2170d1-c5fd-4884-b11a-dab584437ff0', 'e8532894-1420-44a1-b2b1-bf9fe8961433'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:02 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:02 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Delete snapshot completed successfully. Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3b284b0d-3f8b-4679-b112-50402dbbc60f tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-89c49d9d-ae06-4a55-aeaf-b6bf9a6b8373-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "cinder-2234b5f5-f0a5-4315-b1da-43e09aa96fea-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-2234b5f5-f0a5-4315-b1da-43e09aa96fea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:03 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Deleted volume successfully. Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-339ca769-8e10-4eec-b6ec-ba61af02e02f tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-dacc6d17-ab9f-4650-b3bc-8f747cc92abc-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9661fa8f-62e7-4537-9bd1-d2fe4181e374]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:03 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea Sep 02 00:50:03 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:03 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:03 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea Sep 02 00:50:03 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-96d6fa2b-588c-4524-bfce-a3a8fe449635-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-96d6fa2b-588c-4524-bfce-a3a8fe449635-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-quobyte-96d6fa2b-588c-4524-bfce-a3a8fe449635" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-96d6fa2b-588c-4524-bfce-a3a8fe449635" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[723fca61-a73f-45c6-9acc-5d7afac4f23d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:03 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2234b5f5-f0a5-4315-b1da-43e09aa96fea" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-quobyte-2234b5f5-f0a5-4315-b1da-43e09aa96fea" released by "delete_volume" :: held 0.822s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Created reservations ['c81fd95f-994b-4b04-99a1-0cc04df38901', 'b3d95f80-9b14-4627-b9fb-2f5c39c637f3', 'ac8508c0-306f-4a0c-8369-2d65bc67513f', '3afa6f20-ecdd-4f31-bef9-789deacfc60e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:04 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 Sep 02 00:50:04 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:04 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:04 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:04 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635" returned: 0 in 0.524s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:04 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Deleted volume successfully. Sep 02 00:50:04 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635 Sep 02 00:50:04 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7c5592d-1949-435b-b304-3f2ff9abc7f8 tempest-SnapshotsActionsTest-1921209722 None] Lock "cinder-2234b5f5-f0a5-4315-b1da-43e09aa96fea-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:04 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a" returned: 0 in 2.153s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_9wejnimidevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:50:04 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Converted 112.00 MB image at 51.99 MB/s Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:04 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-96d6fa2b-588c-4524-bfce-a3a8fe449635" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:04 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a 1G Sep 02 00:50:04 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-96d6fa2b-588c-4524-bfce-a3a8fe449635" released by "delete_volume" :: held 0.917s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Created reservations ['b2acbc7b-66fc-4d4a-b52c-41091f760fae', 'cd46e9dc-d822-4953-89c2-e8428a25a91c', '20f80573-d68a-44bd-bb8a-cc54c909c941', 'ce677240-d14c-467a-bb01-9cef98158fbc'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:04 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:04 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-a3d56972-f8b7-4f6e-b6c6-03fe413090c2-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-a3d56972-f8b7-4f6e-b6c6-03fe413090c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-quobyte-a3d56972-f8b7-4f6e-b6c6-03fe413090c2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-a3d56972-f8b7-4f6e-b6c6-03fe413090c2" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9875e88-f532-458b-b68e-2e68653acaa7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:05 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a 1G" returned: 0 in 0.442s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Downloaded image 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume 263b5be3-59c5-4884-bbc4-b4609e528c2a successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 for user c462e809358841cba4cb1c74548a805d is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Marking volume 263b5be3-59c5-4884-bbc4-b4609e528c2a as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Copying metadata from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 to 263b5be3-59c5-4884-bbc4-b4609e528c2a. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Creating volume glance metadata for volume 263b5be3-59c5-4884-bbc4-b4609e528c2a backed by image 55fd1d9e-80e7-4ee4-bf99-467853787b78 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:50:05 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:05 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 Sep 02 00:50:05 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Deleted volume successfully. Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f6a06d3d-5c41-45c3-86f3-bd6cb855564e tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-96d6fa2b-588c-4524-bfce-a3a8fe449635-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879b9bce-ad74-40d9-9489-cb38a9f622ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-263b5be3-59c5-4884-bbc4-b4609e528c2a', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cf766a-25cb-4bee-a17a-03b9aebf4c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Volume volume-263b5be3-59c5-4884-bbc4-b4609e528c2a (263b5be3-59c5-4884-bbc4-b4609e528c2a): created successfully Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cf766a-25cb-4bee-a17a-03b9aebf4c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Flow 'volume_create_manager' (13fea27f-abdb-4430-9c14-386b1e80cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-41e5ff57-b863-41c5-b80f-bd26cb197c19 tempest-VolumesImageMetadata-253609965 None] Created volume successfully. Sep 02 00:50:05 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2" returned: 0 in 0.439s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:05 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2 Sep 02 00:50:05 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:05 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a3d56972-f8b7-4f6e-b6c6-03fe413090c2" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-a3d56972-f8b7-4f6e-b6c6-03fe413090c2" released by "delete_volume" :: held 0.771s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Created reservations ['f6fa16f5-b6be-4b6c-8fb4-1e7eafba5cdb', '2bbad771-5ac7-4f37-bead-364c8db547b0', '3d8f9660-5dce-4da0-a2e0-32584e56f2c7', '42685de3-9c0f-4a17-a6b3-b0cfca54cf17'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:06 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:06 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-a0361afb-04f0-4970-aec1-f8a022b3c677-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Acquiring lock "cinder-263b5be3-59c5-4884-bbc4-b4609e528c2a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-a0361afb-04f0-4970-aec1-f8a022b3c677-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Lock "cinder-263b5be3-59c5-4884-bbc4-b4609e528c2a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-quobyte-a0361afb-04f0-4970-aec1-f8a022b3c677" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Acquiring lock "cinder-quobyte-263b5be3-59c5-4884-bbc4-b4609e528c2a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-a0361afb-04f0-4970-aec1-f8a022b3c677" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Lock "cinder-quobyte-263b5be3-59c5-4884-bbc4-b4609e528c2a" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:06 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dde86c9-e58a-475e-9806-e41c80b9b748]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[807e1ee2-561d-4fef-97d2-63927750fc77]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Deleted volume successfully. Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f8abab8-fece-4ee8-a7a1-e13ffcba14c6 tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-a3d56972-f8b7-4f6e-b6c6-03fe413090c2-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:06 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 Sep 02 00:50:06 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:06 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a Sep 02 00:50:06 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:06 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:06 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677 Sep 02 00:50:06 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:06 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a" returned: 0 in 0.430s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:06 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a Sep 02 00:50:06 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:07 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a0361afb-04f0-4970-aec1-f8a022b3c677" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-a0361afb-04f0-4970-aec1-f8a022b3c677" released by "delete_volume" :: held 0.767s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:07 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-263b5be3-59c5-4884-bbc4-b4609e528c2a" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Lock "cinder-quobyte-263b5be3-59c5-4884-bbc4-b4609e528c2a" released by "delete_volume" :: held 0.800s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Created reservations ['8df4b34c-6975-478a-96f7-9151ea7dedc9', '5fb81e0d-d309-4ae7-b269-2a4f21efc823', '44b1dcca-9e88-4714-8607-cc85cf8cbc2f', '99412565-c2e7-427c-a6f6-cf28308903f9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Created reservations ['c36dad47-06fe-438c-8b70-b01a81fa7cb2', 'd8159f9a-afaf-4ad6-a86a-dcbba1bb854d', '605f3e20-8466-443f-b2c9-7576c6743d42', 'b86d4a24-01a6-40f8-8376-1940c8070ea1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:07 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:07 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-655bc2c5-877e-4125-8872-f26fe13afd96-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:07 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-655bc2c5-877e-4125-8872-f26fe13afd96-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:07 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "cinder-quobyte-655bc2c5-877e-4125-8872-f26fe13afd96" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-655bc2c5-877e-4125-8872-f26fe13afd96" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ddac61-bb58-4c5d-bbe8-1f0f494be8b3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:07 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Deleted volume successfully. Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f60b7067-9f1a-4f16-b928-bad5f0751fab tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-a0361afb-04f0-4970-aec1-f8a022b3c677-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:07 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 Sep 02 00:50:07 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:07 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Deleted volume successfully. Sep 02 00:50:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-52feddf6-7d3d-46b9-a79f-4b997b67c5c9 tempest-VolumesImageMetadata-253609965 None] Lock "cinder-263b5be3-59c5-4884-bbc4-b4609e528c2a-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:08 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:08 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96 Sep 02 00:50:08 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:08 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-655bc2c5-877e-4125-8872-f26fe13afd96" returned: 0 in 0.312s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-quobyte-655bc2c5-877e-4125-8872-f26fe13afd96" released by "delete_volume" :: held 0.822s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Created reservations ['b44ea237-96a8-4ce5-be19-3b439841280a', 'd87ec08a-a950-44d1-a9a0-460be57b8b97', 'cf49693e-0609-42f2-8cc0-5c2b69aa8e76', 'a82ab4fe-b5b6-4f6e-ae2d-0e0be7ac2021'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:08 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:08 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:08 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Deleted volume successfully. Sep 02 00:50:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d22703ff-b575-4722-8777-f62c9121a5ae tempest-CreateVolumesFromImageTest-60059381 None] Lock "cinder-655bc2c5-877e-4125-8872-f26fe13afd96-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:12 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:12 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:12 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Flow 'volume_create_manager' (c58b333d-d837-47ac-9ff0-3d79d0bc0f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bca190f-f9ff-4d6a-9c74-33a87d7570be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bca190f-f9ff-4d6a-9c74-33a87d7570be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1448270410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4fe626-d0c6-4c01-9c62-bb2dc58f227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650f6c04c3b242399cb2af261fbe8565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:13Z,use_quota=True,user_id='bc1c7145877742cbb12123f681578c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bce9e76-4cfb-4def-8aac-5b35c280379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bce9e76-4cfb-4def-8aac-5b35c280379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1f1ae6-54a3-488a-9288-a9dd420be329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1f1ae6-54a3-488a-9288-a9dd420be329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4fe626-d0c6-4c01-9c62-bb2dc58f227a', 'volume_name': 'volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cf7a8b-7032-4e44-8b29-d621daff3f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0cf7a8b-7032-4e44-8b29-d621daff3f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381a13fd-2ac6-4e07-be35-880423dafa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Volume cf4fe626-d0c6-4c01-9c62-bb2dc58f227a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a', 'volume_size': 1} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1448270410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4fe626-d0c6-4c01-9c62-bb2dc58f227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650f6c04c3b242399cb2af261fbe8565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:13Z,use_quota=True,user_id='bc1c7145877742cbb12123f681578c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Creating volume cf4fe626-d0c6-4c01-9c62-bb2dc58f227a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:12 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:13 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a 1073741824 Sep 02 00:50:13 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Flow 'volume_create_manager' (658e882f-73e0-4c05-82df-e18e581385de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49671bec-0ef1-48fb-9d0f-a67737de2056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49671bec-0ef1-48fb-9d0f-a67737de2056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf90dca0-a376-405b-a051-e0dab2332861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f533918fe9e4f93bb9d6670b53096b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:13Z,use_quota=True,user_id='54ea935a695e4448a46fa60d6481bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a26b5a-5ecd-4d9d-b442-09e456d7efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a26b5a-5ecd-4d9d-b442-09e456d7efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88feadeb-bb2e-4114-95a0-935c3d29a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88feadeb-bb2e-4114-95a0-935c3d29a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf90dca0-a376-405b-a051-e0dab2332861', 'volume_name': 'volume-bf90dca0-a376-405b-a051-e0dab2332861', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0221c93a-8b74-446b-bc85-d1bd87ea5524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0221c93a-8b74-446b-bc85-d1bd87ea5524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f56a18-34c0-4224-b242-892c8c8e47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Volume bf90dca0-a376-405b-a051-e0dab2332861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf90dca0-a376-405b-a051-e0dab2332861', 'volume_size': 1} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:13 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a 1073741824" returned: 0 in 0.469s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:13 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a Sep 02 00:50:13 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:13 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf90dca0-a376-405b-a051-e0dab2332861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f533918fe9e4f93bb9d6670b53096b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:13Z,use_quota=True,user_id='54ea935a695e4448a46fa60d6481bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Creating volume bf90dca0-a376-405b-a051-e0dab2332861 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:13 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:13 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 1073741824 Sep 02 00:50:13 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381a13fd-2ac6-4e07-be35-880423dafa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540b2b07-97c0-4f38-aef2-a3f172ccc22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Volume volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a (cf4fe626-d0c6-4c01-9c62-bb2dc58f227a): created successfully Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540b2b07-97c0-4f38-aef2-a3f172ccc22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Flow 'volume_create_manager' (c58b333d-d837-47ac-9ff0-3d79d0bc0f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1e33fbfc-7808-41cc-99b2-f7461219a18e tempest-AbsoluteLimitsTests-1443278480 None] Created volume successfully. Sep 02 00:50:14 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 1073741824" returned: 0 in 0.493s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:14 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 Sep 02 00:50:14 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:14 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f56a18-34c0-4224-b242-892c8c8e47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf90dca0-a376-405b-a051-e0dab2332861', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9448a401-16b2-44ff-8135-c6222a9a7c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Volume volume-bf90dca0-a376-405b-a051-e0dab2332861 (bf90dca0-a376-405b-a051-e0dab2332861): created successfully Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9448a401-16b2-44ff-8135-c6222a9a7c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Flow 'volume_create_manager' (658e882f-73e0-4c05-82df-e18e581385de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-284fd8d2-d453-4207-9e70-39ee709d5952 tempest-CinderUnicodeTest-693993830 None] Created volume successfully. Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Flow 'volume_create_manager' (7f206170-df3f-4bff-929b-58baad756b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34edf1d-87a0-4030-adda-1ac3636e2e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34edf1d-87a0-4030-adda-1ac3636e2e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-231470107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1d7d48-0478-43bf-b56e-df45b35d042f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873c92d67b53428192e0afc3056866c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:15Z,use_quota=True,user_id='c0aba88e185747cfae9cd7d4273cd4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d216f4-12f3-481e-840e-36bb3545f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d216f4-12f3-481e-840e-36bb3545f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d9dc8-ed3e-4368-8395-a8a32763f9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d9dc8-ed3e-4368-8395-a8a32763f9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1d7d48-0478-43bf-b56e-df45b35d042f', 'volume_name': 'volume-6e1d7d48-0478-43bf-b56e-df45b35d042f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5173fdb-2c81-43d8-97ec-eb6f0da33fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5173fdb-2c81-43d8-97ec-eb6f0da33fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4354e3e7-6ea4-4657-bd51-5562b5625a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Volume 6e1d7d48-0478-43bf-b56e-df45b35d042f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1d7d48-0478-43bf-b56e-df45b35d042f', 'volume_size': 1} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-231470107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1d7d48-0478-43bf-b56e-df45b35d042f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873c92d67b53428192e0afc3056866c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:15Z,use_quota=True,user_id='c0aba88e185747cfae9cd7d4273cd4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Creating volume 6e1d7d48-0478-43bf-b56e-df45b35d042f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:14 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f 1073741824 Sep 02 00:50:14 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Acquiring lock "cinder-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Lock "cinder-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Acquiring lock "cinder-quobyte-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Lock "cinder-quobyte-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca36a91-9ccc-4324-8ab7-e2b498bf6236]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:15 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a Sep 02 00:50:15 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:15 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f 1073741824" returned: 0 in 0.520s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:15 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f Sep 02 00:50:15 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:15 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a" returned: 0 in 0.468s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:15 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a Sep 02 00:50:15 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:15 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Flow 'volume_create_manager' (1a49d8bf-2714-4218-a2d5-39a87f6bd262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fea8609-16c7-4041-8a79-a8fd0915a393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fea8609-16c7-4041-8a79-a8fd0915a393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1507528915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3236ce-3741-424b-b381-71b0f8df8011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f533918fe9e4f93bb9d6670b53096b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:16Z,use_quota=True,user_id='54ea935a695e4448a46fa60d6481bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a963611-c98c-4244-9873-0541cf37260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a963611-c98c-4244-9873-0541cf37260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733f09bd-6b02-4da2-aa0f-00755bab2bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733f09bd-6b02-4da2-aa0f-00755bab2bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3236ce-3741-424b-b381-71b0f8df8011', 'volume_name': 'volume-ef3236ce-3741-424b-b381-71b0f8df8011', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3df1071-25b5-472e-8e62-7591ccc0ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3df1071-25b5-472e-8e62-7591ccc0ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4cf9a9-2d4d-4c5c-86d8-7da05891fb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Volume ef3236ce-3741-424b-b381-71b0f8df8011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3236ce-3741-424b-b381-71b0f8df8011', 'volume_size': 1} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1507528915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3236ce-3741-424b-b381-71b0f8df8011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f533918fe9e4f93bb9d6670b53096b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:16Z,use_quota=True,user_id='54ea935a695e4448a46fa60d6481bd97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Creating volume ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:16 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4354e3e7-6ea4-4657-bd51-5562b5625a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1d7d48-0478-43bf-b56e-df45b35d042f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660971f1-eb5d-4de4-a708-5c2fb2ec40d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:16 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 1073741824 Sep 02 00:50:16 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Volume volume-6e1d7d48-0478-43bf-b56e-df45b35d042f (6e1d7d48-0478-43bf-b56e-df45b35d042f): created successfully Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660971f1-eb5d-4de4-a708-5c2fb2ec40d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Flow 'volume_create_manager' (7f206170-df3f-4bff-929b-58baad756b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:16 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a" returned: 0 in 0.320s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-02949e86-5f8c-4b60-9a59-e4ed11b958f6 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Created volume successfully. Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Lock "cinder-quobyte-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a" released by "delete_volume" :: held 0.847s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Created reservations ['06cf7cf1-f164-446d-8a75-027481bb3cfa', '5f6fe2da-c6e9-4faa-bf8c-d1102871e7d6', '07e8e6cb-20df-455e-90e5-a3b041b35af3', '4ee1c767-3b95-4846-8bf9-aabefaf7b78e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:16 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:16 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:16 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Deleted volume successfully. Sep 02 00:50:16 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 1073741824" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4372260f-fd37-4da4-87c0-c69e0af8e7cd tempest-AbsoluteLimitsTests-1443278480 None] Lock "cinder-cf4fe626-d0c6-4c01-9c62-bb2dc58f227a-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:16 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 Sep 02 00:50:16 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:16 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4cf9a9-2d4d-4c5c-86d8-7da05891fb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3236ce-3741-424b-b381-71b0f8df8011', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041682f2-dfe4-4259-b8e6-aecf2cd21fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Flow 'volume_create_manager' (d8510eb6-9f5e-489a-8e4c-dda12a0da62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764aa9c2-7098-4062-b37d-dfa3f0ed7add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Volume volume-ef3236ce-3741-424b-b381-71b0f8df8011 (ef3236ce-3741-424b-b381-71b0f8df8011): created successfully Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041682f2-dfe4-4259-b8e6-aecf2cd21fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Flow 'volume_create_manager' (1a49d8bf-2714-4218-a2d5-39a87f6bd262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764aa9c2-7098-4062-b37d-dfa3f0ed7add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1161812946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277e509e-b010-4d7e-9636-b9619dd6e42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23db74c5e7ad4e5cb4a005cebc244b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:17Z,use_quota=True,user_id='0c0e7aa64fba45d7a449600ede913c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f07d64-3d3a-4ba7-bf38-a6edc4b9c0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f07d64-3d3a-4ba7-bf38-a6edc4b9c0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624ddd21-ab52-4a89-be54-a7e98306a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624ddd21-ab52-4a89-be54-a7e98306a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277e509e-b010-4d7e-9636-b9619dd6e42a', 'volume_name': 'volume-277e509e-b010-4d7e-9636-b9619dd6e42a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31c326b-8c32-4706-8a79-f458117393a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31c326b-8c32-4706-8a79-f458117393a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7837bc24-e43f-4d82-81ca-e62ff5c6c055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Volume 277e509e-b010-4d7e-9636-b9619dd6e42a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277e509e-b010-4d7e-9636-b9619dd6e42a', 'volume_size': 1} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1161812946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277e509e-b010-4d7e-9636-b9619dd6e42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23db74c5e7ad4e5cb4a005cebc244b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:17Z,use_quota=True,user_id='0c0e7aa64fba45d7a449600ede913c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Creating volume 277e509e-b010-4d7e-9636-b9619dd6e42a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:17 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3e425c3b-2456-4270-9a72-b66bd054ecfe tempest-CinderUnicodeTest-693993830 None] Created volume successfully. Sep 02 00:50:17 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a 1073741824 Sep 02 00:50:17 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:17 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a 1073741824" returned: 0 in 0.584s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:17 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a Sep 02 00:50:17 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c35f564a-019c-4950-afe2-567645e517d0 req-888533e8-83f3-4b91-8662-0e76c99176ed tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:18 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a" returned: 0 in 0.279s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c35f564a-019c-4950-afe2-567645e517d0 req-888533e8-83f3-4b91-8662-0e76c99176ed tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.137s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7837bc24-e43f-4d82-81ca-e62ff5c6c055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277e509e-b010-4d7e-9636-b9619dd6e42a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc51f6c-ea1d-432c-9d2e-7b9b34b9264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c35f564a-019c-4950-afe2-567645e517d0 req-888533e8-83f3-4b91-8662-0e76c99176ed tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Volume volume-277e509e-b010-4d7e-9636-b9619dd6e42a (277e509e-b010-4d7e-9636-b9619dd6e42a): created successfully Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc51f6c-ea1d-432c-9d2e-7b9b34b9264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Flow 'volume_create_manager' (d8510eb6-9f5e-489a-8e4c-dda12a0da62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fbd27911-87e2-46fe-8f25-ee41a0d1b083 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Created volume successfully. Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-c35f564a-019c-4950-afe2-567645e517d0 req-888533e8-83f3-4b91-8662-0e76c99176ed tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-6e1d7d48-0478-43bf-b56e-df45b35d042f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '263b4cb5-602e-4e60-99f0-27eced55897c', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:50:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-c35f564a-019c-4950-afe2-567645e517d0 req-888533e8-83f3-4b91-8662-0e76c99176ed tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] attachment_update completed successfully. Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Creating offline snapshot 87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 of volume ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fa161c-1052-4cbf-984d-a43eeec0885a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:18 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 Sep 02 00:50:18 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:18 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:19 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 1G Sep 02 00:50:19 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:19 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 1G" returned: 0 in 0.592s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3236ce-3741-424b-b381-71b0f8df8011 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:19 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3236ce-3741-424b-b381-71b0f8df8011 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 Sep 02 00:50:19 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:19 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef3236ce-3741-424b-b381-71b0f8df8011 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 is being set with open permissions: ugo+rw Sep 02 00:50:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:19 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 Sep 02 00:50:19 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:20 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=133,cinder:UPDATE=144,cinder:INSERT=46,cinder:DELETE=13 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Acquiring lock "cinder-277e509e-b010-4d7e-9636-b9619dd6e42a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:20 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.info Sep 02 00:50:20 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "cinder-277e509e-b010-4d7e-9636-b9619dd6e42a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=130,cinder:UPDATE=168,cinder:DELETE=15,cinder:INSERT=42 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Acquiring lock "cinder-quobyte-277e509e-b010-4d7e-9636-b9619dd6e42a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "cinder-quobyte-277e509e-b010-4d7e-9636-b9619dd6e42a" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc76d43-ee48-461a-acba-b3b95d8b7b69]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:20 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a Sep 02 00:50:20 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:20 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.info" returned: 0 in 0.505s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:20 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.info is being set with open permissions: ugo+rw Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:20 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.info Sep 02 00:50:20 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:20 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:20 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a Sep 02 00:50:20 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:21 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.info" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.680s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0144071b-854f-419e-82d8-5ae221ef922e tempest-CinderUnicodeTest-693993830 None] Create snapshot completed successfully Sep 02 00:50:21 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-277e509e-b010-4d7e-9636-b9619dd6e42a" returned: 0 in 0.295s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "cinder-quobyte-277e509e-b010-4d7e-9636-b9619dd6e42a" released by "delete_volume" :: held 0.807s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Created reservations ['c5902783-667d-462d-b014-1ff68d296234', 'e71c4ce9-4afe-4759-9be8-4977c3286e02', '84164d11-3fb6-46f3-ac12-9a968a8594bd', '8684c76d-64c9-46a4-8d5f-73d439ed61da'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:21 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:21 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Flow 'volume_create_manager' (460ba72b-baad-43f6-95c9-93401ae69736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857a5f3b-8cf9-46d7-82a7-621c6380352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857a5f3b-8cf9-46d7-82a7-621c6380352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-708933225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9755d4-eff8-45d2-a8a0-8571a01297ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014600e5216b4e16996d08c41362020d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:21Z,use_quota=True,user_id='77fc0a991e9a468983deb0ceb97cc50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292c5382-a2cb-43ae-95c0-b0be39075f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292c5382-a2cb-43ae-95c0-b0be39075f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0582f438-5972-44bd-bbdb-924dddf1759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0582f438-5972-44bd-bbdb-924dddf1759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f9755d4-eff8-45d2-a8a0-8571a01297ca', 'volume_name': 'volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ce7a76-5d3e-48e1-86a5-701ffab836b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ce7a76-5d3e-48e1-86a5-701ffab836b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc907fb-1552-4f0a-b36c-f69dc50bb101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Volume 8f9755d4-eff8-45d2-a8a0-8571a01297ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca', 'volume_size': 1} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-708933225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9755d4-eff8-45d2-a8a0-8571a01297ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014600e5216b4e16996d08c41362020d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:21Z,use_quota=True,user_id='77fc0a991e9a468983deb0ceb97cc50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Creating volume 8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:21 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:21 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca 1073741824 Sep 02 00:50:21 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "cinder-87aa93ff-4d82-4fa0-a007-d7d4d62a3e98-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-87aa93ff-4d82-4fa0-a007-d7d4d62a3e98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "cinder-quobyte-ef3236ce-3741-424b-b381-71b0f8df8011" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-ef3236ce-3741-424b-b381-71b0f8df8011" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "cinder-quobyte-87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Deleting offline snapshot 87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 of volume ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] snapshot_file for this snap is: volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:50:21 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e7c9b-12eb-4c76-b879-057a2c0fbe33]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Deleted volume successfully. Sep 02 00:50:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7c9cd02-9975-4f3e-8a0a-fc7e020245e1 tempest-VolumeQuotasNegativeTestJSON-169636062 None] Lock "cinder-277e509e-b010-4d7e-9636-b9619dd6e42a-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:22 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 Sep 02 00:50:22 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-1fc31884-1db1-4dc6-b5cd-4e04cf13f76b req-8077ac0f-3c36-46b5-898b-ba4ad1468a66 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Terminate volume connection completed successfully. Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-1fc31884-1db1-4dc6-b5cd-4e04cf13f76b req-8077ac0f-3c36-46b5-898b-ba4ad1468a66 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Deleting attachment 263b4cb5-602e-4e60-99f0-27eced55897c. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:50:22 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca 1073741824" returned: 0 in 0.574s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:22 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca Sep 02 00:50:22 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:22 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef3236ce-3741-424b-b381-71b0f8df8011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[381bad27-0cbb-49ad-bd3e-b979adf388b7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:22 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc907fb-1552-4f0a-b36c-f69dc50bb101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dda021-9721-46bc-b798-c6e401530883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:22 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 Sep 02 00:50:22 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Volume volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca (8f9755d4-eff8-45d2-a8a0-8571a01297ca): created successfully Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9dda021-9721-46bc-b798-c6e401530883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Flow 'volume_create_manager' (460ba72b-baad-43f6-95c9-93401ae69736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0b857298-f201-4e76-a4ce-e3933fb0b3a2 tempest-VolumesDeleteCascade-1487883446 None] Created volume successfully. Sep 02 00:50:22 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Acquiring lock "cinder-6e1d7d48-0478-43bf-b56e-df45b35d042f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:23 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 Sep 02 00:50:23 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "cinder-6e1d7d48-0478-43bf-b56e-df45b35d042f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Acquiring lock "cinder-quobyte-6e1d7d48-0478-43bf-b56e-df45b35d042f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "cinder-quobyte-6e1d7d48-0478-43bf-b56e-df45b35d042f" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d68b3d-b4dd-4dc4-9c4d-e0b990ada978]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:23 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f Sep 02 00:50:23 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:23 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:23 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98 Sep 02 00:50:23 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:23 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:23 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f Sep 02 00:50:23 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:23 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011.87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-87aa93ff-4d82-4fa0-a007-d7d4d62a3e98" released by "_delete_snapshot" :: held 1.886s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-ef3236ce-3741-424b-b381-71b0f8df8011" released by "delete_snapshot" :: held 1.929s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Created reservations ['beec3ddd-712b-4895-b3db-f39891c08e4a', '86876fc4-34c8-442f-9e0a-37a0f0153d73', '3123fefc-cd67-4f80-8cdd-5d02f7730c81', '7ce6e6c1-21d6-47dc-bc67-0b1da7bdd634'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:23 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6e1d7d48-0478-43bf-b56e-df45b35d042f" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "cinder-quobyte-6e1d7d48-0478-43bf-b56e-df45b35d042f" released by "delete_volume" :: held 0.819s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Delete snapshot completed successfully. Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-828acf36-0318-426a-a5d6-589de92ead68 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-87aa93ff-4d82-4fa0-a007-d7d4d62a3e98-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Created reservations ['9880199f-1ecb-4b51-bf1a-cb0f921c3e06', 'ab12a643-3913-47e4-97c3-6cb005176e80', '9d20b906-3de4-48b5-9c4e-fa32511b6560', 'd507f6df-6d62-474b-a182-0d9daaea9272'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Creating offline snapshot 5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e of volume 8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b3f405-8fea-4542-a02a-af27b6997d7b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:24 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:24 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:24 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca Sep 02 00:50:24 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:24 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Deleted volume successfully. Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-810ca7b6-3ab4-40af-be87-2ec33dfb7984 tempest-TestServerVolumeAttachScenarioOldVersion-1539886198 None] Lock "cinder-6e1d7d48-0478-43bf-b56e-df45b35d042f-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:24 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca" returned: 0 in 0.590s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:24 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e 1G Sep 02 00:50:24 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Acquiring lock "cinder-ef3236ce-3741-424b-b381-71b0f8df8011-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Lock "cinder-ef3236ce-3741-424b-b381-71b0f8df8011-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Acquiring lock "cinder-quobyte-ef3236ce-3741-424b-b381-71b0f8df8011" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-ef3236ce-3741-424b-b381-71b0f8df8011" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4bcb2-d0de-45d4-9bc6-cd3fdc38ce54]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:25 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 Sep 02 00:50:25 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:25 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e 1G" returned: 0 in 0.820s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:25 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e Sep 02 00:50:25 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:25 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011" returned: 0 in 0.518s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:25 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011 Sep 02 00:50:25 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:25 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:25 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e is being set with open permissions: ugo+rw Sep 02 00:50:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:25 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e Sep 02 00:50:25 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:26 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ef3236ce-3741-424b-b381-71b0f8df8011" returned: 0 in 0.447s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-ef3236ce-3741-424b-b381-71b0f8df8011" released by "delete_volume" :: held 1.067s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Created reservations ['1ca33872-ca72-4d81-a01b-f9d6b2e73605', '327e1936-5cec-4fbb-abdf-9d2a1bcece9c', 'c36cd113-2962-4a10-bea2-32084f87ab31', 'dcdf5c8a-7ede-41b2-904b-be24ed56e0cc'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:26 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" returned: 0 in 0.522s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:26 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.info Sep 02 00:50:26 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:26 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:26 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:26 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.info" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:26 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.info is being set with open permissions: ugo+rw Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:26 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Deleted volume successfully. Sep 02 00:50:26 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.info Sep 02 00:50:26 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056339e9-aedd-4ba7-8be7-1d69965c20df tempest-CinderUnicodeTest-693993830 None] Lock "cinder-ef3236ce-3741-424b-b381-71b0f8df8011-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:27 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.info" returned: 0 in 0.313s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.166s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-88a17d4b-e9d5-43a3-b407-bc57e727f6c7 tempest-VolumesDeleteCascade-1487883446 None] Create snapshot completed successfully Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "cinder-bf90dca0-a376-405b-a051-e0dab2332861-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-bf90dca0-a376-405b-a051-e0dab2332861-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "cinder-quobyte-bf90dca0-a376-405b-a051-e0dab2332861" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-bf90dca0-a376-405b-a051-e0dab2332861" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e235af5-2cd8-479b-8d1c-75e707803dfb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:27 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 Sep 02 00:50:27 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:28 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:28 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861 Sep 02 00:50:28 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:28 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bf90dca0-a376-405b-a051-e0dab2332861" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-quobyte-bf90dca0-a376-405b-a051-e0dab2332861" released by "delete_volume" :: held 0.778s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Created reservations ['7804715f-0ae8-431a-a253-01fb3c1a0e52', '25fcbe65-d05b-4cc2-baa5-0f9af9d772b2', '02e59d0b-394c-48dc-a0ce-5b026d549c7d', 'c9066b2c-4c26-4b0e-82eb-1e55ed75f913'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:28 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:28 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Creating offline snapshot da26a6de-ab29-4e0a-882b-e10a383fd118 of volume 8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f678b34-4012-4b24-a546-fb0078690767]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:28 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e Sep 02 00:50:28 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:29 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:29 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Deleted volume successfully. Sep 02 00:50:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-42d5131e-0dd9-4305-a3c0-527a61ddb814 tempest-CinderUnicodeTest-693993830 None] Lock "cinder-bf90dca0-a376-405b-a051-e0dab2332861-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:29 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" returned: 0 in 0.711s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:29 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 1G Sep 02 00:50:29 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Flow 'volume_create_manager' (657cb395-2dc1-4775-b9d6-9a1230937bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b3f341-b209-4ec5-b269-ed8158354330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:30 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 1G" returned: 0 in 0.619s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:30 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 Sep 02 00:50:30 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b3f341-b209-4ec5-b269-ed8158354330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1677313831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6221eb99-167f-4e6d-976c-afe8cfe630c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0801ebeb11664b8abdb26fa005223844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:30Z,use_quota=True,user_id='7cde67e3e2fc400db586a09e96f71755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e628584f-8150-405a-876b-959fc731e117),volume_type_id=e628584f-8150-405a-876b-959fc731e117)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32280c76-7e42-4c98-a06f-55c6e2f956e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32280c76-7e42-4c98-a06f-55c6e2f956e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52bfa3e-65ca-46cf-8497-65da0cc6c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52bfa3e-65ca-46cf-8497-65da0cc6c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6221eb99-167f-4e6d-976c-afe8cfe630c2', 'volume_name': 'volume-6221eb99-167f-4e6d-976c-afe8cfe630c2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0a7574-7a45-4ebe-9018-182d8377089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0a7574-7a45-4ebe-9018-182d8377089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3aac66-c2bb-4f18-a0f7-86ef92a17af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Volume 6221eb99-167f-4e6d-976c-afe8cfe630c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6221eb99-167f-4e6d-976c-afe8cfe630c2', 'volume_size': 1} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:30 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:30 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 is being set with open permissions: ugo+rw Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:30 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 Sep 02 00:50:30 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:30 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1677313831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6221eb99-167f-4e6d-976c-afe8cfe630c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0801ebeb11664b8abdb26fa005223844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:30Z,use_quota=True,user_id='7cde67e3e2fc400db586a09e96f71755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e628584f-8150-405a-876b-959fc731e117),volume_type_id=e628584f-8150-405a-876b-959fc731e117)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Creating volume 6221eb99-167f-4e6d-976c-afe8cfe630c2 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:30 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 1073741824 Sep 02 00:50:30 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-80009766-d123-4fc7-983b-cfdd780f9387 tempest-VolumesDeleteCascade-1487883446 None] Create snapshot completed successfully Sep 02 00:50:31 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 1073741824" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:31 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 Sep 02 00:50:31 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:31 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3aac66-c2bb-4f18-a0f7-86ef92a17af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6221eb99-167f-4e6d-976c-afe8cfe630c2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938ccb97-5164-41de-a57e-7bf37aa2bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Volume volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 (6221eb99-167f-4e6d-976c-afe8cfe630c2): created successfully Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (938ccb97-5164-41de-a57e-7bf37aa2bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Flow 'volume_create_manager' (657cb395-2dc1-4775-b9d6-9a1230937bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5507a3af-ffd4-4370-8e0c-e648144eeea3 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Created volume successfully. Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-8f9755d4-eff8-45d2-a8a0-8571a01297ca-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-8f9755d4-eff8-45d2-a8a0-8571a01297ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Performing cascade delete. {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Deleting offline snapshot 5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e of volume 8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] snapshot_file for this snap is: volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11b0333-34b8-411d-a354-f63e0018adb4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:32 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e Sep 02 00:50:32 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:32 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b573c367-272e-4695-8362-8793e49f7f15]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:32 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:32 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:32 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca Sep 02 00:50:32 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:32 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:32 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-79e9fbd3-b9fb-4f4c-a605-4645e36e5404 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Retype volume completed successfully. Sep 02 00:50:33 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca" returned: 0 in 0.502s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca03c09-5f9a-4ea6-81d8-dd4b909bc04b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:33 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 Sep 02 00:50:33 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (87426d9e-3675-4d49-a83c-5380bcf1af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ace634-689e-48a8-b590-72c9f1627dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ace634-689e-48a8-b590-72c9f1627dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10212781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075c4ba4-9d6d-43d4-a598-2c49ecf7c929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:33Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d711ee-30d0-4b80-bada-c4797b4d0df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d711ee-30d0-4b80-bada-c4797b4d0df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f364e415-0f47-4aca-add3-0f264029ab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f364e415-0f47-4aca-add3-0f264029ab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075c4ba4-9d6d-43d4-a598-2c49ecf7c929', 'volume_name': 'volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0a9393-91a8-41ee-b5f0-94ce623f6b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0a9393-91a8-41ee-b5f0-94ce623f6b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487d74b8-b6d9-46d9-b688-48b32d47f8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Volume 075c4ba4-9d6d-43d4-a598-2c49ecf7c929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929', 'volume_size': 1} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10212781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075c4ba4-9d6d-43d4-a598-2c49ecf7c929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:33Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Creating volume 075c4ba4-9d6d-43d4-a598-2c49ecf7c929 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:33 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:33 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 1073741824 Sep 02 00:50:33 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:33 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce64cbfc-cc86-4385-b5a7-d40cd6f885d7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:33 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e Sep 02 00:50:33 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Acquiring lock "cinder-6221eb99-167f-4e6d-976c-afe8cfe630c2-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "cinder-6221eb99-167f-4e6d-976c-afe8cfe630c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Acquiring lock "cinder-quobyte-6221eb99-167f-4e6d-976c-afe8cfe630c2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "cinder-quobyte-6221eb99-167f-4e6d-976c-afe8cfe630c2" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:33 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bbbca9-7d74-4209-a026-f97c17d9ecf3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 1073741824" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:34 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 Sep 02 00:50:34 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:34 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 Sep 02 00:50:34 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:34 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" returned: 0 in 0.607s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69e80b2-4a8c-4a79-a7ff-678d99c5df1a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:34 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca Sep 02 00:50:34 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:34 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2" returned: 0 in 0.491s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:34 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929" returned: 0 in 0.450s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:34 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2 Sep 02 00:50:34 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (487d74b8-b6d9-46d9-b688-48b32d47f8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f2ec3a-5d45-4eb7-ae4e-c7d5ae716f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Volume volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 (075c4ba4-9d6d-43d4-a598-2c49ecf7c929): created successfully Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f2ec3a-5d45-4eb7-ae4e-c7d5ae716f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (87426d9e-3675-4d49-a83c-5380bcf1af68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-72631f2c-1902-441c-89d1-6f7fb5947a66 tempest-ProjectReaderTests-1104408351 None] Created volume successfully. Sep 02 00:50:34 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:34 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e Sep 02 00:50:34 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:34 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6221eb99-167f-4e6d-976c-afe8cfe630c2" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "cinder-quobyte-6221eb99-167f-4e6d-976c-afe8cfe630c2" released by "delete_volume" :: held 0.846s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:34 devstack cinder-volume[87232]: WARNING cinder.quota [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:50:34 devstack cinder-volume[87232]: WARNING cinder.quota [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Created reservations ['76d8393b-0780-4afb-9037-72fb6288cc14', '4dc1f854-ed86-454c-b6d8-5a74326bdfe0', '2118c477-5e67-4624-bce7-e50d86643314', 'bcab4460-2b79-4266-a2fe-86f7a2dade58'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:34 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:34 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:35 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:35 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e Sep 02 00:50:35 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:35 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Deleted volume successfully. Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6f37fef-f067-4994-b297-8b794212a218 tempest-VolumeRetypeWithoutMigrationTest-700227961 None] Lock "cinder-6221eb99-167f-4e6d-976c-afe8cfe630c2-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:35 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" returned: 0 in 0.399s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 -F qcow2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:35 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 -F qcow2 Sep 02 00:50:35 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-075c4ba4-9d6d-43d4-a598-2c49ecf7c929-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-075c4ba4-9d6d-43d4-a598-2c49ecf7c929-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-quobyte-075c4ba4-9d6d-43d4-a598-2c49ecf7c929" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-075c4ba4-9d6d-43d4-a598-2c49ecf7c929" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb216f5-e3d1-4bdd-a916-c03d2d198d39]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:35 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 Sep 02 00:50:35 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:35 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 -F qcow2" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e" released by "_delete_snapshot" :: held 4.057s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" released by "delete_snapshot" :: held 4.086s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Created reservations ['b424ab82-3c14-40c2-97bf-0d2f12d31f3d', 'e06eb1a4-309a-4901-bc56-fd0eeeab371d', '171615a5-5139-4480-8590-9bba90f2f6f5', '6e78b5a1-060e-47da-ad60-8778731ec35b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:36 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929" returned: 0 in 0.495s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Delete snapshot completed successfully. Sep 02 00:50:36 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929 Sep 02 00:50:36 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-5d348b2f-48ff-40c6-afd8-2c14fdc6ab6e-delete_snapshot" released by "delete_snapshot" :: held 4.400s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-da26a6de-ab29-4e0a-882b-e10a383fd118-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-da26a6de-ab29-4e0a-882b-e10a383fd118-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-da26a6de-ab29-4e0a-882b-e10a383fd118" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-da26a6de-ab29-4e0a-882b-e10a383fd118" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Deleting offline snapshot da26a6de-ab29-4e0a-882b-e10a383fd118 of volume 8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] snapshot_file for this snap is: volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6804ffb-0e24-4415-ab55-bc7d27c34aba]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:36 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 Sep 02 00:50:36 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:36 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-075c4ba4-9d6d-43d4-a598-2c49ecf7c929" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-075c4ba4-9d6d-43d4-a598-2c49ecf7c929" released by "delete_volume" :: held 0.953s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Created reservations ['dc4f9b6d-a974-465a-970e-c3d3a4139e8c', '3767ea21-453b-4fae-bfb8-aec0be261568', 'a0032549-82d2-40b3-8ee8-5089b5bb667a', '9c5652f8-aa65-4d54-91d5-db83742d1555'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:36 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:36 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:37 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118" returned: 0 in 0.548s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[874cbdfa-6a7a-44cc-8882-13389c3789b1]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:37 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Deleted volume successfully. Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-060746a9-de21-4fc1-971b-33f6cae04f88 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-075c4ba4-9d6d-43d4-a598-2c49ecf7c929-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:37 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca Sep 02 00:50:37 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:37 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:37 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 Sep 02 00:50:37 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:38 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:38 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118 Sep 02 00:50:38 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:38 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca.da26a6de-ab29-4e0a-882b-e10a383fd118" returned: 0 in 0.312s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-da26a6de-ab29-4e0a-882b-e10a383fd118" released by "_delete_snapshot" :: held 1.910s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" released by "delete_snapshot" :: held 1.965s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Created reservations ['5f511f70-9a78-49b0-9b22-3ba71babaa25', '1fa8f217-921a-4563-9d2f-c4b870d4e12f', 'b65cb098-f808-40e9-b4c6-62767aec385a', '52b0cd1e-29c4-41e3-962e-fdb21f24cf05'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Delete snapshot completed successfully. Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-da26a6de-ab29-4e0a-882b-e10a383fd118-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Snapshots deleted, issuing volume delete {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (afbfe77a-0f08-4b60-902f-6e5b61f337c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813afcd7-4f26-4d18-8704-c01380ec8264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b6ff16-0119-47d0-88f1-97368a7c671b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813afcd7-4f26-4d18-8704-c01380ec8264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474747462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1784b9-3553-47aa-ae74-c3bef6d17eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:39Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b27911-2faf-46c3-b6cd-cadd182e0244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b27911-2faf-46c3-b6cd-cadd182e0244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f07ceea-2666-4185-8407-4692e45a8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f07ceea-2666-4185-8407-4692e45a8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1784b9-3553-47aa-ae74-c3bef6d17eae', 'volume_name': 'volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa28a66-27d1-46ac-8c69-610f79c9f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa28a66-27d1-46ac-8c69-610f79c9f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4c99fc-f57d-4abe-a8f7-4a21983e95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Volume 1a1784b9-3553-47aa-ae74-c3bef6d17eae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae', 'volume_size': 1} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474747462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1784b9-3553-47aa-ae74-c3bef6d17eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:39Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Creating volume 1a1784b9-3553-47aa-ae74-c3bef6d17eae {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:38 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:38 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:38 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:38 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae 1073741824 Sep 02 00:50:38 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:39 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca" returned: 0 in 0.514s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:39 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca Sep 02 00:50:39 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:39 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae 1073741824" returned: 0 in 0.638s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:39 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8f9755d4-eff8-45d2-a8a0-8571a01297ca" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-8f9755d4-eff8-45d2-a8a0-8571a01297ca" released by "delete_volume" :: held 0.950s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:39 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae Sep 02 00:50:39 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Created reservations ['28389c11-fb51-4b7c-98e1-24773422093c', '83af8f5d-fdea-41b7-a5ad-cf93ddb89853', '86d99049-83f8-40f2-ae9b-da7b86476d57', '1ee9901e-5bbf-49fa-a833-7154f140091f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:39 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:39 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:40 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4c99fc-f57d-4abe-a8f7-4a21983e95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a77ea3-bd92-40cf-a81c-e161216e2cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Volume volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae (1a1784b9-3553-47aa-ae74-c3bef6d17eae): created successfully Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a77ea3-bd92-40cf-a81c-e161216e2cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (afbfe77a-0f08-4b60-902f-6e5b61f337c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c93f60bd-7f55-4590-a802-1ec5cd9d2188 tempest-ProjectReaderTests-1104408351 None] Created volume successfully. Sep 02 00:50:40 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Deleted volume successfully. Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-172821d8-ff40-450f-8414-4423d3b1a3d8 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-8f9755d4-eff8-45d2-a8a0-8571a01297ca-delete_volume" released by "delete_volume" :: held 8.352s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-1a1784b9-3553-47aa-ae74-c3bef6d17eae-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Lock "cinder-1a1784b9-3553-47aa-ae74-c3bef6d17eae-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-quobyte-1a1784b9-3553-47aa-ae74-c3bef6d17eae" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-1a1784b9-3553-47aa-ae74-c3bef6d17eae" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bd4347-bec9-4bb0-9a84-f84b3f4c5e37]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:41 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae Sep 02 00:50:41 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:41 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae" returned: 0 in 0.574s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:41 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae Sep 02 00:50:41 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Flow 'volume_create_manager' (88cf9612-23fe-4270-a275-0e8d0e9678da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3461c534-d032-450f-9676-96b3f2344c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3461c534-d032-450f-9676-96b3f2344c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1817858020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28722a33-8ea0-44ec-91e6-34af50216557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014600e5216b4e16996d08c41362020d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:41Z,use_quota=True,user_id='77fc0a991e9a468983deb0ceb97cc50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1186044-7fab-4e0b-8cc6-7a9aa716d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1186044-7fab-4e0b-8cc6-7a9aa716d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d9e2f7-f21a-4671-8d43-e2a49680d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d9e2f7-f21a-4671-8d43-e2a49680d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28722a33-8ea0-44ec-91e6-34af50216557', 'volume_name': 'volume-28722a33-8ea0-44ec-91e6-34af50216557', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32102086-c436-4b87-9d17-122b283cc3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32102086-c436-4b87-9d17-122b283cc3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a4032-2db3-49dd-8b22-0add67650a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Volume 28722a33-8ea0-44ec-91e6-34af50216557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28722a33-8ea0-44ec-91e6-34af50216557', 'volume_size': 1} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1817858020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28722a33-8ea0-44ec-91e6-34af50216557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014600e5216b4e16996d08c41362020d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:41Z,use_quota=True,user_id='77fc0a991e9a468983deb0ceb97cc50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Creating volume 28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:41 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:41 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 1073741824 Sep 02 00:50:41 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:41 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1a1784b9-3553-47aa-ae74-c3bef6d17eae" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-1a1784b9-3553-47aa-ae74-c3bef6d17eae" released by "delete_volume" :: held 0.996s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:41 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Created reservations ['17920863-fbe8-4ba1-a973-1622dde848fa', 'f289d29a-0017-4b7d-92e0-82dc5026c2d0', '19d9f4be-731c-4311-88bf-6830addc573d', 'ac218f9d-2781-4371-905d-254ba823f1db'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:42 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:42 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:42 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 1073741824" returned: 0 in 0.605s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:42 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 Sep 02 00:50:42 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:42 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.320s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Deleted volume successfully. Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-65e5f72b-8199-4284-9012-efc8715df65b tempest-ProjectReaderTests-1104408351 None] Lock "cinder-1a1784b9-3553-47aa-ae74-c3bef6d17eae-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:42 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38a4032-2db3-49dd-8b22-0add67650a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28722a33-8ea0-44ec-91e6-34af50216557', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0efca6-d1a2-48ef-9f2f-54c04dbb1bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Volume volume-28722a33-8ea0-44ec-91e6-34af50216557 (28722a33-8ea0-44ec-91e6-34af50216557): created successfully Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0efca6-d1a2-48ef-9f2f-54c04dbb1bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Flow 'volume_create_manager' (88cf9612-23fe-4270-a275-0e8d0e9678da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c52ef6ba-62a2-4790-a882-03af7813f963 tempest-VolumesDeleteCascade-1487883446 None] Created volume successfully. Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Flow 'volume_create_manager' (0b069bda-8f51-41f6-8631-117c6a2c0fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c22ad1-06fe-4624-8f3f-8186d243dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c22ad1-06fe-4624-8f3f-8186d243dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1916549517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02055b8-c9e7-4059-92da-45fa1119a0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6fc3868bde4cddb91c9cae0b140562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:43Z,use_quota=True,user_id='7fc1eaa1d81e43759f18228152ab4ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fb3de1-7123-4cd9-945b-b55eaea700b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fb3de1-7123-4cd9-945b-b55eaea700b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05dfd3c-ad84-4ac3-93cf-b1c114240242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05dfd3c-ad84-4ac3-93cf-b1c114240242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02055b8-c9e7-4059-92da-45fa1119a0f6', 'volume_name': 'volume-a02055b8-c9e7-4059-92da-45fa1119a0f6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65014f09-6160-4705-81fe-7bf0ac584038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65014f09-6160-4705-81fe-7bf0ac584038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafbe3b0-f748-4a02-919e-83825eed5de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Volume a02055b8-c9e7-4059-92da-45fa1119a0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02055b8-c9e7-4059-92da-45fa1119a0f6', 'volume_size': 1} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1916549517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02055b8-c9e7-4059-92da-45fa1119a0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6fc3868bde4cddb91c9cae0b140562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:43Z,use_quota=True,user_id='7fc1eaa1d81e43759f18228152ab4ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Creating volume a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:42 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:42 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 1073741824 Sep 02 00:50:42 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:43 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 1073741824" returned: 0 in 0.504s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:43 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 Sep 02 00:50:43 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (0ebef440-b471-459a-be91-3260f124db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7681de-c8a3-412e-b1b4-055484593069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7681de-c8a3-412e-b1b4-055484593069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770609635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88342b5d-3b3a-4566-bf89-8593bd3de743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:44Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26fe954-0e87-4472-9e5a-210a2d009617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26fe954-0e87-4472-9e5a-210a2d009617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb8972-1f69-408e-af5c-7d763c531d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb8972-1f69-408e-af5c-7d763c531d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88342b5d-3b3a-4566-bf89-8593bd3de743', 'volume_name': 'volume-88342b5d-3b3a-4566-bf89-8593bd3de743', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ec3907-efb4-45d8-96c9-471184de9b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:43 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ec3907-efb4-45d8-96c9-471184de9b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7973cf6d-91e3-47e3-8f59-584db9ed04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Volume 88342b5d-3b3a-4566-bf89-8593bd3de743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88342b5d-3b3a-4566-bf89-8593bd3de743', 'volume_size': 1} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770609635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88342b5d-3b3a-4566-bf89-8593bd3de743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:44Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Creating volume 88342b5d-3b3a-4566-bf89-8593bd3de743 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:43 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:43 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 1073741824 Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafbe3b0-f748-4a02-919e-83825eed5de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02055b8-c9e7-4059-92da-45fa1119a0f6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:43 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869cced9-1df7-4498-885c-b9853e1debf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Volume volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 (a02055b8-c9e7-4059-92da-45fa1119a0f6): created successfully Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869cced9-1df7-4498-885c-b9853e1debf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Flow 'volume_create_manager' (0b069bda-8f51-41f6-8631-117c6a2c0fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0019cee7-0dcb-43a6-883c-e10fb30c1877 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Created volume successfully. Sep 02 00:50:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:44 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 1073741824" returned: 0 in 0.513s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:44 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 Sep 02 00:50:44 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:44 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743" returned: 0 in 0.273s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.702s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7973cf6d-91e3-47e3-8f59-584db9ed04d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88342b5d-3b3a-4566-bf89-8593bd3de743', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dc7e38-4aeb-4493-a9b3-73156b8f7fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Creating offline snapshot 32a7d24d-6fcf-4d95-ac39-79730cc141a6 of volume 28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:50:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Volume volume-88342b5d-3b3a-4566-bf89-8593bd3de743 (88342b5d-3b3a-4566-bf89-8593bd3de743): created successfully Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dc7e38-4aeb-4493-a9b3-73156b8f7fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (0ebef440-b471-459a-be91-3260f124db21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e9082-4dde-4fcc-a8dc-87c492d9009d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3ab489c2-b58c-4ff6-a637-7fd25f56772d tempest-ProjectReaderTests-1104408351 None] Created volume successfully. Sep 02 00:50:44 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 Sep 02 00:50:44 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:45 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:45 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 1G Sep 02 00:50:45 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:45 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 1G" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28722a33-8ea0-44ec-91e6-34af50216557 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:45 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28722a33-8ea0-44ec-91e6-34af50216557 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 Sep 02 00:50:45 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-88342b5d-3b3a-4566-bf89-8593bd3de743-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-88342b5d-3b3a-4566-bf89-8593bd3de743-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-quobyte-88342b5d-3b3a-4566-bf89-8593bd3de743" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-88342b5d-3b3a-4566-bf89-8593bd3de743" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:45 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28722a33-8ea0-44ec-91e6-34af50216557 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:45 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 is being set with open permissions: ugo+rw Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cecb66-858d-4f87-9f8c-d961f5da7dab]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:45 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 Sep 02 00:50:45 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:46 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 Sep 02 00:50:46 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:46 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:46 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.info Sep 02 00:50:46 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:46 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743" returned: 0 in 0.395s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:46 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743 Sep 02 00:50:46 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:46 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.info" returned: 0 in 0.273s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:46 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.info is being set with open permissions: ugo+rw Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:46 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.info Sep 02 00:50:46 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:46 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-88342b5d-3b3a-4566-bf89-8593bd3de743" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-88342b5d-3b3a-4566-bf89-8593bd3de743" released by "delete_volume" :: held 0.722s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Created reservations ['b385adca-e4af-4518-b379-4c376bcac39e', '0776805d-e366-4cdd-8dd1-6c778fd78bdd', 'fd078df1-3da0-4d8e-a691-3a3357bad2b0', '1311bd5e-324c-4e76-b9d6-b7734385fade'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:46 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.info" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:46 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:46 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.726s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Creating offline snapshot d4324732-ecd1-403c-8262-105a58c9f502 of volume a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:50:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e27d0990-2a11-4dd5-bf12-157cd69a6ed2 tempest-VolumesDeleteCascade-1487883446 None] Create snapshot completed successfully Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f8e7d9-9347-4264-bfde-e75db765156e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:47 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 Sep 02 00:50:47 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:47 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Deleted volume successfully. Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-575049c0-14fd-452b-9cc2-aa8620f05179 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-88342b5d-3b3a-4566-bf89-8593bd3de743-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:47 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6" returned: 0 in 0.462s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:47 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 1G Sep 02 00:50:47 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (5938dba6-9ecc-43f8-9a1e-55da33dfbe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d506b8-0209-40c2-8fab-659628718acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d506b8-0209-40c2-8fab-659628718acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676086034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d6147c-8628-4f58-bc4e-0263d13616b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:48Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c164aa7c-9ffb-4f47-865c-ca441da9530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c164aa7c-9ffb-4f47-865c-ca441da9530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52af01f3-5b74-4765-8b6b-41f5b947c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52af01f3-5b74-4765-8b6b-41f5b947c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d6147c-8628-4f58-bc4e-0263d13616b3', 'volume_name': 'volume-45d6147c-8628-4f58-bc4e-0263d13616b3', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c69618-fcd4-447e-bd41-9b75ab9f0eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c69618-fcd4-447e-bd41-9b75ab9f0eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6343baf2-10cd-4b27-8b0a-68556e6f4aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Volume 45d6147c-8628-4f58-bc4e-0263d13616b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d6147c-8628-4f58-bc4e-0263d13616b3', 'volume_size': 1} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:47 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 1G" returned: 0 in 0.542s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:47 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:50:47 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Flow 'volume_create_manager' (1954a7af-5e89-4494-8358-ee7644d47418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ba2ec5-e3c8-4cec-aedb-966e377dfc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ba2ec5-e3c8-4cec-aedb-966e377dfc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1365629854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014600e5216b4e16996d08c41362020d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32a7d24d-6fcf-4d95-ac39-79730cc141a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:48Z,use_quota=True,user_id='77fc0a991e9a468983deb0ceb97cc50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e124ae60-d2a0-4e9b-9616-17847fc668fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e124ae60-d2a0-4e9b-9616-17847fc668fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70da4a8-af90-4b76-be57-c854ccfba9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70da4a8-af90-4b76-be57-c854ccfba9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39', 'volume_name': 'volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39', 'volume_size': 1, 'snapshot_id': '32a7d24d-6fcf-4d95-ac39-79730cc141a6'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4bf78f-c277-4260-ac9b-c95f339e17c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4bf78f-c277-4260-ac9b-c95f339e17c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218a4f65-5aaf-45e3-812b-f2ff41c198b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Volume 0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39', 'volume_size': 1, 'snapshot_id': '32a7d24d-6fcf-4d95-ac39-79730cc141a6'} Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:48 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502" returned: 0 in 0.312s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 is being set with open permissions: ugo+rw Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:48 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 Sep 02 00:50:48 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:48 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502" returned: 0 in 0.397s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:48 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.info Sep 02 00:50:48 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:48 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.info" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.info is being set with open permissions: ugo+rw Sep 02 00:50:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:48 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.info Sep 02 00:50:48 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:49 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.info" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676086034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d6147c-8628-4f58-bc4e-0263d13616b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47ed65dee434599899f3c7e76171e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:50:48Z,use_quota=True,user_id='6b26cb4340b64497a8a899552eaf2e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Creating volume 45d6147c-8628-4f58-bc4e-0263d13616b3 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:49 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:49 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 1073741824 Sep 02 00:50:49 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a344488f-6af5-43ee-b76e-c6ab71f2d03a tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Create snapshot completed successfully Sep 02 00:50:49 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 1073741824" returned: 0 in 0.516s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:49 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 Sep 02 00:50:49 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:50 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.033s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-32a7d24d-6fcf-4d95-ac39-79730cc141a6-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "cinder-d4324732-ecd1-403c-8262-105a58c9f502-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6343baf2-10cd-4b27-8b0a-68556e6f4aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d6147c-8628-4f58-bc4e-0263d13616b3', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1595e0d-864a-4c00-b205-1f5aa12f61fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-32a7d24d-6fcf-4d95-ac39-79730cc141a6-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Creating volume 0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 from snapshot 32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-d4324732-ecd1-403c-8262-105a58c9f502-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "cinder-quobyte-a02055b8-c9e7-4059-92da-45fa1119a0f6" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Volume volume-45d6147c-8628-4f58-bc4e-0263d13616b3 (45d6147c-8628-4f58-bc4e-0263d13616b3): created successfully Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1595e0d-864a-4c00-b205-1f5aa12f61fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Flow 'volume_create_manager' (5938dba6-9ecc-43f8-9a1e-55da33dfbe8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-quobyte-a02055b8-c9e7-4059-92da-45fa1119a0f6" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "cinder-quobyte-d4324732-ecd1-403c-8262-105a58c9f502" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] snapshot: 32a7d24d-6fcf-4d95-ac39-79730cc141a6, volume: 0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:50:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-74873b6c-9df3-4a4a-b050-26fa331810ef tempest-ProjectReaderTests-1104408351 None] Created volume successfully. Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-quobyte-d4324732-ecd1-403c-8262-105a58c9f502" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Deleting offline snapshot d4324732-ecd1-403c-8262-105a58c9f502 of volume a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] snapshot_file for this snap is: volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74776b2-83bc-44d5-8c02-eb0dc934d5bb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e63aaf-dc6b-4b36-b32d-b5c4255a1f19]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:50 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 Sep 02 00:50:50 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:50 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 Sep 02 00:50:50 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:50 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28722a33-8ea0-44ec-91e6-34af50216557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:50 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502" returned: 0 in 0.447s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a02055b8-c9e7-4059-92da-45fa1119a0f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0669e142-287b-4f18-b527-ce741b3349ae]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07ff213-453b-4064-ae35-7896bb11f408]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-45d6147c-8628-4f58-bc4e-0263d13616b3-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-45d6147c-8628-4f58-bc4e-0263d13616b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:50 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 Sep 02 00:50:50 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "cinder-quobyte-45d6147c-8628-4f58-bc4e-0263d13616b3" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-45d6147c-8628-4f58-bc4e-0263d13616b3" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9367ec0f-0e4b-40af-aa80-72a6e40cb08f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:51 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 Sep 02 00:50:51 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:51 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 Sep 02 00:50:51 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:51 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:51 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 Sep 02 00:50:51 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:51 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6" returned: 0 in 0.584s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:51 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 Sep 02 00:50:51 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:51 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3" returned: 0 in 0.455s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:51 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3 Sep 02 00:50:51 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:51 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-45d6147c-8628-4f58-bc4e-0263d13616b3" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-quobyte-45d6147c-8628-4f58-bc4e-0263d13616b3" released by "delete_volume" :: held 0.848s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Created reservations ['16584073-9df4-480b-8105-084874509608', '1bc2963b-d832-4a6c-ae94-d89f9382731e', '28e8e6dd-6be2-4778-b4d0-8dcc675cb823', '62ba938f-f958-4049-8ae8-0ab8148ec713'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:52 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502" returned: 0 in 0.650s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:52 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502 Sep 02 00:50:52 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:52 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:52 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:52 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6.d4324732-ecd1-403c-8262-105a58c9f502" returned: 0 in 0.859s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-quobyte-d4324732-ecd1-403c-8262-105a58c9f502" released by "_delete_snapshot" :: held 2.823s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-quobyte-a02055b8-c9e7-4059-92da-45fa1119a0f6" released by "delete_snapshot" :: held 2.913s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:53 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.878s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Deleted volume successfully. Sep 02 00:50:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-75635a7b-3e03-4c5a-8f4e-dd3cfede7128 tempest-ProjectReaderTests-1104408351 None] Lock "cinder-45d6147c-8628-4f58-bc4e-0263d13616b3-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:53 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Created reservations ['51ab3c41-ec1b-4af3-9c13-16c68766d8cf', '293c376c-1d34-4576-8b4f-2d6e5d5cbc98', 'd30b4c7f-90be-4774-a981-254f2d26247d', '1237c56a-8d8e-41ab-8f73-132aeda62772'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Delete snapshot completed successfully. Sep 02 00:50:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a9c682d1-7f9b-452f-9149-c0c480605dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-d4324732-ecd1-403c-8262-105a58c9f502-delete_snapshot" released by "delete_snapshot" :: held 3.400s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "cinder-a02055b8-c9e7-4059-92da-45fa1119a0f6-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-a02055b8-c9e7-4059-92da-45fa1119a0f6-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "cinder-quobyte-a02055b8-c9e7-4059-92da-45fa1119a0f6" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-quobyte-a02055b8-c9e7-4059-92da-45fa1119a0f6" acquired by "delete_volume" :: waited 0.053s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e1af58-1a5f-4f48-919a-3d406e94db60]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:55 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 Sep 02 00:50:55 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:56 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6" returned: 0 in 1.092s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:56 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6 Sep 02 00:50:56 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:57 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" returned: 0 in 6.110s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:50:57 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Converted 1024.00 MB image at 167.55 MB/s Sep 02 00:50:57 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 is being set with open permissions: ugo+rw Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:57 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 Sep 02 00:50:57 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:57 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a02055b8-c9e7-4059-92da-45fa1119a0f6" returned: 0 in 0.966s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-quobyte-a02055b8-c9e7-4059-92da-45fa1119a0f6" released by "delete_volume" :: held 2.248s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Created reservations ['cf34a0ea-7b95-4bbc-a74a-c4187c89ef58', 'b81df86c-b193-4424-8777-531c16d6c9ab', 'ea9afed1-35e2-49d8-a530-1c65006cc059', '691eb89f-9a54-40c4-8c51-79e67063bdb0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:50:57 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" released by "_copy_volume_from_snapshot" :: held 7.553s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:57 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:50:57 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-32a7d24d-6fcf-4d95-ac39-79730cc141a6-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" released by "_create_volume_from_snapshot" :: held 7.698s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.751s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218a4f65-5aaf-45e3-812b-f2ff41c198b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39', 'volume_size': 1, 'snapshot_id': '32a7d24d-6fcf-4d95-ac39-79730cc141a6'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f28a90-412d-454b-a208-bc6f46d1989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:50:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Volume volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 (0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39): created successfully Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f28a90-412d-454b-a208-bc6f46d1989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:50:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Flow 'volume_create_manager' (1954a7af-5e89-4494-8358-ee7644d47418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:50:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ce253c57-5c2a-4f62-bf51-d118ec807c99 tempest-VolumesDeleteCascade-1487883446 None] Created volume successfully. Sep 02 00:50:58 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:50:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Deleted volume successfully. Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eec8c7a8-4a6c-44e4-ae04-ef0bff1f2f88 tempest-VolumeSnapshotQuotasNegativeTestJSON-1782709429 None] Lock "cinder-a02055b8-c9e7-4059-92da-45fa1119a0f6-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-28722a33-8ea0-44ec-91e6-34af50216557-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-28722a33-8ea0-44ec-91e6-34af50216557-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Performing cascade delete. {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-32a7d24d-6fcf-4d95-ac39-79730cc141a6-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-32a7d24d-6fcf-4d95-ac39-79730cc141a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-28722a33-8ea0-44ec-91e6-34af50216557" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-28722a33-8ea0-44ec-91e6-34af50216557" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-32a7d24d-6fcf-4d95-ac39-79730cc141a6" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-32a7d24d-6fcf-4d95-ac39-79730cc141a6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Deleting offline snapshot 32a7d24d-6fcf-4d95-ac39-79730cc141a6 of volume 28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] snapshot_file for this snap is: volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e00803-77f1-47f3-8ff7-ca60b1c8829d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:58 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 Sep 02 00:50:58 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:59 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6" returned: 0 in 0.455s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28722a33-8ea0-44ec-91e6-34af50216557(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:50:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b119277-0791-4728-99fe-06c43bf98eee]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:50:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:59 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 Sep 02 00:50:59 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:50:59 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 02 00:50:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557" returned: 0 in 0.661s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:50:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:50:59 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 Sep 02 00:50:59 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:00 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:00 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6 Sep 02 00:51:00 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:00 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557.32a7d24d-6fcf-4d95-ac39-79730cc141a6" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-32a7d24d-6fcf-4d95-ac39-79730cc141a6" released by "_delete_snapshot" :: held 1.899s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-28722a33-8ea0-44ec-91e6-34af50216557" released by "delete_snapshot" :: held 1.937s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Created reservations ['326dbf0b-8f65-402e-b599-78697926444b', '9add21ef-34cf-45bd-a2fc-aa8e175f3e9b', '88e5d350-5613-488a-982b-9ca49fa3c221', '63a6d177-9214-48a3-8aa5-dff6732f44d1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Delete snapshot completed successfully. Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-32a7d24d-6fcf-4d95-ac39-79730cc141a6-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Snapshots deleted, issuing volume delete {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-28722a33-8ea0-44ec-91e6-34af50216557" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-28722a33-8ea0-44ec-91e6-34af50216557" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e953e359-1c0e-46b5-9df9-130cb7fed376]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:00 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 Sep 02 00:51:00 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:01 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557" returned: 0 in 0.422s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:01 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557 Sep 02 00:51:01 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:01 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-28722a33-8ea0-44ec-91e6-34af50216557" returned: 0 in 0.335s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-28722a33-8ea0-44ec-91e6-34af50216557" released by "delete_volume" :: held 0.847s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Created reservations ['2b1cb57a-d3de-4858-bc22-50d29823bcfb', 'd83464ed-7977-4db8-bf8d-bca8bd22d02a', 'd632387a-153b-4ebb-820b-d76e7eecb9be', 'ed0334f5-65a1-4666-b2c8-d142d9ff94a4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:01 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:01 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:01 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Deleted volume successfully. Sep 02 00:51:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b99c7a-6d5c-42bb-83dc-ed047146dc39 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-28722a33-8ea0-44ec-91e6-34af50216557-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "cinder-quobyte-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a7295-01eb-4d96-9793-7cb91709bad9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:02 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 Sep 02 00:51:02 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:02 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:02 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39 Sep 02 00:51:02 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:02 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-quobyte-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39" released by "delete_volume" :: held 0.778s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Created reservations ['3996ceba-a2ee-44e6-a973-66d81dff2473', '3cc85e8b-ee0b-4b3b-aa3b-86430eb1ec9f', '1dbf33ee-629c-496e-81ba-180486759f1b', '4a007eb9-7315-4ed0-ba0a-f53ab1da94a3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:03 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:03 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:03 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Deleted volume successfully. Sep 02 00:51:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-604b9d22-ae32-4127-bfcd-a8d4df28b908 tempest-VolumesDeleteCascade-1487883446 None] Lock "cinder-0b0fda7f-f6a4-4f98-9f21-bd2d0a67df39-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Flow 'volume_create_manager' (5fa06f45-31b8-4f85-8c80-2c768cb9075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9815827e-2d61-4544-a23b-1fd43529cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9815827e-2d61-4544-a23b-1fd43529cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2077939788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e41003-5e8c-4b02-8468-5994143dc4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa3bbf553604c4ca65ace1bab1a7a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:06Z,use_quota=True,user_id='5d47fabcb0ec4416b0e21821c1a9989c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fe994c-d4cb-4ffd-bf98-f9b333d920c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fe994c-d4cb-4ffd-bf98-f9b333d920c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d921847c-84d9-4ee0-9062-43a15913c000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d921847c-84d9-4ee0-9062-43a15913c000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9e41003-5e8c-4b02-8468-5994143dc4a1', 'volume_name': 'volume-c9e41003-5e8c-4b02-8468-5994143dc4a1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37119537-2188-4401-9769-ce90bc7dfc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37119537-2188-4401-9769-ce90bc7dfc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3714ca-0c26-4fea-ae47-f892277f4f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Volume c9e41003-5e8c-4b02-8468-5994143dc4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9e41003-5e8c-4b02-8468-5994143dc4a1', 'volume_size': 1} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2077939788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e41003-5e8c-4b02-8468-5994143dc4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa3bbf553604c4ca65ace1bab1a7a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:06Z,use_quota=True,user_id='5d47fabcb0ec4416b0e21821c1a9989c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Creating volume c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:06 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:06 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 1073741824 Sep 02 00:51:06 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:06 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 1073741824" returned: 0 in 0.591s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:06 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 Sep 02 00:51:06 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:07 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3714ca-0c26-4fea-ae47-f892277f4f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e41003-5e8c-4b02-8468-5994143dc4a1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6af70e2-73bd-4f75-8dfe-8d95b7c23563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:07 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Volume volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 (c9e41003-5e8c-4b02-8468-5994143dc4a1): created successfully Sep 02 00:51:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6af70e2-73bd-4f75-8dfe-8d95b7c23563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Flow 'volume_create_manager' (5fa06f45-31b8-4f85-8c80-2c768cb9075e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-606f7f84-566b-4650-8d80-92cf202d1845 tempest-SnapshotMetadataTestJSON-1326872042 None] Created volume successfully. Sep 02 00:51:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Creating offline snapshot 0ef7cc98-bc38-4c36-8a3d-efbfc7940963 of volume c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:51:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc06115-8502-4e30-93dd-befcc68d24fc]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:08 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 Sep 02 00:51:08 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:09 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1" returned: 0 in 0.554s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:09 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 1G Sep 02 00:51:09 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:09 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 1G" returned: 0 in 0.566s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:09 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 Sep 02 00:51:09 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:10 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963" returned: 0 in 0.414s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:10 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 is being set with open permissions: ugo+rw Sep 02 00:51:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:10 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 Sep 02 00:51:10 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:10 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:10 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.info Sep 02 00:51:10 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:11 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.info" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:11 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.info is being set with open permissions: ugo+rw Sep 02 00:51:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:11 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.info Sep 02 00:51:11 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:11 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.info" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-144c613e-2f7e-4892-adcf-58efd223bc6d tempest-SnapshotMetadataTestJSON-1326872042 None] Create snapshot completed successfully Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:12 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:12 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Flow 'volume_create_manager' (1bcd85f8-6a2a-4205-b1e1-3de66a4cb1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fae680-121a-4b92-ba3d-c1035ef5c609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fae680-121a-4b92-ba3d-c1035ef5c609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2091940872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17e2672-42c7-4ec4-b893-ce94905b0d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609d66082bb8418b89c1693de12f4f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:13Z,use_quota=True,user_id='f676bab5b56647d3a29ba3d8714f8970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d7c4c8-297d-4f30-9112-49fa9ee7d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d7c4c8-297d-4f30-9112-49fa9ee7d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead96b0b-ca70-4d0a-909a-d9927d990c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead96b0b-ca70-4d0a-909a-d9927d990c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17e2672-42c7-4ec4-b893-ce94905b0d0f', 'volume_name': 'volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cc92b5-cefa-4516-ab1d-10a6b8d8a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cc92b5-cefa-4516-ab1d-10a6b8d8a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:12 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c9c8a2-3b66-4649-adf7-4401b1dc7174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Volume a17e2672-42c7-4ec4-b893-ce94905b0d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f', 'volume_size': 1} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2091940872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17e2672-42c7-4ec4-b893-ce94905b0d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609d66082bb8418b89c1693de12f4f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:13Z,use_quota=True,user_id='f676bab5b56647d3a29ba3d8714f8970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Creating volume a17e2672-42c7-4ec4-b893-ce94905b0d0f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:12 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.550s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:51:12 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f 1073741824 Sep 02 00:51:12 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "cinder-0ef7cc98-bc38-4c36-8a3d-efbfc7940963-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-0ef7cc98-bc38-4c36-8a3d-efbfc7940963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "cinder-quobyte-c9e41003-5e8c-4b02-8468-5994143dc4a1" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-quobyte-c9e41003-5e8c-4b02-8468-5994143dc4a1" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "cinder-quobyte-0ef7cc98-bc38-4c36-8a3d-efbfc7940963" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-quobyte-0ef7cc98-bc38-4c36-8a3d-efbfc7940963" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Deleting offline snapshot 0ef7cc98-bc38-4c36-8a3d-efbfc7940963 of volume c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] snapshot_file for this snap is: volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11e8e9-8675-4fc9-81e8-5f3378d30e94]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:13 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 Sep 02 00:51:13 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:13 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f 1073741824" returned: 0 in 0.592s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:13 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f Sep 02 00:51:13 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:13 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963" returned: 0 in 0.511s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9e41003-5e8c-4b02-8468-5994143dc4a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f1ec46-4e60-4041-a4aa-d3028ed778fb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:13 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 Sep 02 00:51:13 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:13 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c9c8a2-3b66-4649-adf7-4401b1dc7174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182ddc18-21cc-427c-9107-55aa24f90a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Volume volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f (a17e2672-42c7-4ec4-b893-ce94905b0d0f): created successfully Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182ddc18-21cc-427c-9107-55aa24f90a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Flow 'volume_create_manager' (1bcd85f8-6a2a-4205-b1e1-3de66a4cb1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Flow 'volume_create_manager' (3764789c-57ee-4c41-9ee7-c15c33bb8a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29597357-cb8f-4a24-9037-5b7218294f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29597357-cb8f-4a24-9037-5b7218294f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-564359788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e34c5ccca84ab9a29122791aa62d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:14Z,use_quota=True,user_id='ce6af251a6554a8c9298ed5d9dfc787d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf496ef-be4c-43bf-9711-de246c1f952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf496ef-be4c-43bf-9711-de246c1f952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee0846e-6254-40dc-803d-8ac12af861b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee0846e-6254-40dc-803d-8ac12af861b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d', 'volume_name': 'volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d05e0fa-9107-4d29-9dd8-822fd8547d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d05e0fa-9107-4d29-9dd8-822fd8547d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9977919f-8fe0-4ac7-92fa-ecc8eb321d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Volume 6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d', 'volume_size': 1} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-564359788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e34c5ccca84ab9a29122791aa62d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:14Z,use_quota=True,user_id='ce6af251a6554a8c9298ed5d9dfc787d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Creating volume 6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:13 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-38044de9-bfcc-44f9-803e-82a29ea10c4c tempest-VolumesTransfersTest-373637741 None] Created volume successfully. Sep 02 00:51:13 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d 1073741824 Sep 02 00:51:13 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:14 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1" returned: 0 in 0.655s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:14 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 Sep 02 00:51:14 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Flow 'volume_create_manager' (93242a41-f892-44cf-94e5-0e33e0a71487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bf17bc-7d8a-45d0-a71a-be98d3ffb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bf17bc-7d8a-45d0-a71a-be98d3ffb942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1731174228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a47de7-93ab-4dbd-a589-309688d54bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e34c5ccca84ab9a29122791aa62d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:14Z,use_quota=True,user_id='ce6af251a6554a8c9298ed5d9dfc787d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b3b8e4-09a6-40ce-a2b1-35391b8ab33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b3b8e4-09a6-40ce-a2b1-35391b8ab33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fc23fd-68c3-44af-98dc-c524ebace683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fc23fd-68c3-44af-98dc-c524ebace683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a47de7-93ab-4dbd-a589-309688d54bb4', 'volume_name': 'volume-65a47de7-93ab-4dbd-a589-309688d54bb4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c92658-c4e1-45f6-a354-b80167ee55f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c92658-c4e1-45f6-a354-b80167ee55f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1ca21f-6f07-412b-b851-edb9eb158a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Volume 65a47de7-93ab-4dbd-a589-309688d54bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a47de7-93ab-4dbd-a589-309688d54bb4', 'volume_size': 1} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:14 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d 1073741824" returned: 0 in 0.677s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:14 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d Sep 02 00:51:14 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:14 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963" returned: 0 in 0.606s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:14 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963 Sep 02 00:51:14 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:15 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1.0ef7cc98-bc38-4c36-8a3d-efbfc7940963" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:15 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d" returned: 0 in 0.524s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-quobyte-0ef7cc98-bc38-4c36-8a3d-efbfc7940963" released by "_delete_snapshot" :: held 2.353s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1731174228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a47de7-93ab-4dbd-a589-309688d54bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e34c5ccca84ab9a29122791aa62d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:14Z,use_quota=True,user_id='ce6af251a6554a8c9298ed5d9dfc787d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Creating volume 65a47de7-93ab-4dbd-a589-309688d54bb4 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:15 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-quobyte-c9e41003-5e8c-4b02-8468-5994143dc4a1" released by "delete_snapshot" :: held 2.454s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9977919f-8fe0-4ac7-92fa-ecc8eb321d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23486a-4319-410b-8601-60e1e0a0d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:15 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 1073741824 Sep 02 00:51:15 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Volume volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d (6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d): created successfully Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d23486a-4319-410b-8601-60e1e0a0d795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Flow 'volume_create_manager' (3764789c-57ee-4c41-9ee7-c15c33bb8a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ae7950ce-3a62-443d-be26-08b9dcf76c20 tempest-TestServerVolumeAttachmentScenario-624672231 None] Created volume successfully. Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Created reservations ['7dce9b93-2919-4378-9a3c-76d111d6c5c5', '0907fed7-8c40-4f28-a829-4b153017a38e', '094f4992-d6e0-4683-bc23-2dded9831070', 'f9b3fea9-9e2d-411e-9d87-0df8668f8779'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-84fb1ff5-4cf7-4089-b4a1-d890c1ecd90b tempest-VolumesTransfersTest-1953083959 None] Transfer volume completed successfully. Sep 02 00:51:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Delete snapshot completed successfully. Sep 02 00:51:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa496afe-9cc6-45f0-87da-24f4b607305b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-0ef7cc98-bc38-4c36-8a3d-efbfc7940963-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:16 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 1073741824" returned: 0 in 0.821s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:16 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 Sep 02 00:51:16 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Acquiring lock "cinder-a17e2672-42c7-4ec4-b893-ce94905b0d0f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "cinder-c9e41003-5e8c-4b02-8468-5994143dc4a1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-a17e2672-42c7-4ec4-b893-ce94905b0d0f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-c9e41003-5e8c-4b02-8468-5994143dc4a1-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Acquiring lock "cinder-quobyte-a17e2672-42c7-4ec4-b893-ce94905b0d0f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-quobyte-a17e2672-42c7-4ec4-b893-ce94905b0d0f" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "cinder-quobyte-c9e41003-5e8c-4b02-8468-5994143dc4a1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c58985-b41d-459c-b2b6-9df67c16e760]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-quobyte-c9e41003-5e8c-4b02-8468-5994143dc4a1" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f1d976-d2e0-4541-9947-ad58a0777389]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:16 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f Sep 02 00:51:16 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:16 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 Sep 02 00:51:16 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:16 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4" returned: 0 in 0.554s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1ca21f-6f07-412b-b851-edb9eb158a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a47de7-93ab-4dbd-a589-309688d54bb4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfd1e20-da3a-499b-8d15-21db7c44f87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Volume volume-65a47de7-93ab-4dbd-a589-309688d54bb4 (65a47de7-93ab-4dbd-a589-309688d54bb4): created successfully Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfd1e20-da3a-499b-8d15-21db7c44f87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Flow 'volume_create_manager' (93242a41-f892-44cf-94e5-0e33e0a71487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6980c798-a5cc-40b1-9c34-71f6e8ce8762 tempest-TestServerVolumeAttachmentScenario-624672231 None] Created volume successfully. Sep 02 00:51:17 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f" returned: 0 in 0.536s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:17 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1" returned: 0 in 0.483s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:17 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f Sep 02 00:51:17 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:17 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1 Sep 02 00:51:17 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:17 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-a17e2672-42c7-4ec4-b893-ce94905b0d0f" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:17 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c9e41003-5e8c-4b02-8468-5994143dc4a1" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-quobyte-a17e2672-42c7-4ec4-b893-ce94905b0d0f" released by "delete_volume" :: held 0.946s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-quobyte-c9e41003-5e8c-4b02-8468-5994143dc4a1" released by "delete_volume" :: held 0.906s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Created reservations ['d70805c7-132b-40f8-976f-23751df4a5bb', 'f7ee4d6c-ee88-4507-a554-5a0d62e4f045', '3734c84e-8820-461d-a179-6ae861953ca6', '101695d0-7489-4ec1-9368-d054235ab798'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Created reservations ['11c00e3b-dfa2-474c-8747-06897266f576', '56995c65-26a4-412f-939d-967b5b667cf3', '9f349e6c-17f5-420b-bf68-e57dec1fc9de', 'd2f2c32d-2057-4d9e-91b1-aa4b075ccd65'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:17 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:17 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:17 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:17 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:17 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.290s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Deleted volume successfully. Sep 02 00:51:17 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.278s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf06123-979d-47b4-b53f-46edecf0a458 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-a17e2672-42c7-4ec4-b893-ce94905b0d0f-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Deleted volume successfully. Sep 02 00:51:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b280561-b02e-4246-b920-ce3c3785aa5b tempest-SnapshotMetadataTestJSON-1326872042 None] Lock "cinder-c9e41003-5e8c-4b02-8468-5994143dc4a1-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Flow 'volume_create_manager' (7ad1149c-eb59-4f68-b5dd-ac36710f308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dbe419-9172-49b5-9a9a-757b49576470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dbe419-9172-49b5-9a9a-757b49576470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-441644782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe72a4f-b862-450c-9b23-2fed88d57c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609d66082bb8418b89c1693de12f4f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:19Z,use_quota=True,user_id='f676bab5b56647d3a29ba3d8714f8970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcc1d01-fb74-4e53-bb2e-207ce2baae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcc1d01-fb74-4e53-bb2e-207ce2baae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0606d9b-fb98-4377-87f1-024f4ea360d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0606d9b-fb98-4377-87f1-024f4ea360d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe72a4f-b862-450c-9b23-2fed88d57c39', 'volume_name': 'volume-cfe72a4f-b862-450c-9b23-2fed88d57c39', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a748651-6d12-4ddf-9df3-f8ae0acdd088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a748651-6d12-4ddf-9df3-f8ae0acdd088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3ca2ff-2076-4a25-9f42-eb8ec9bcf125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:19 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Volume cfe72a4f-b862-450c-9b23-2fed88d57c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe72a4f-b862-450c-9b23-2fed88d57c39', 'volume_size': 1} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-441644782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe72a4f-b862-450c-9b23-2fed88d57c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609d66082bb8418b89c1693de12f4f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:19Z,use_quota=True,user_id='f676bab5b56647d3a29ba3d8714f8970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Creating volume cfe72a4f-b862-450c-9b23-2fed88d57c39 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:19 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:19 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 1073741824 Sep 02 00:51:19 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:20 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 1073741824" returned: 0 in 0.626s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:20 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 Sep 02 00:51:20 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:20 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=159,cinder:UPDATE=194,cinder:DELETE=16,cinder:INSERT=49 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3ca2ff-2076-4a25-9f42-eb8ec9bcf125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe72a4f-b862-450c-9b23-2fed88d57c39', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6004592-3581-4f56-807b-2d691851139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=166,cinder:DELETE=18,cinder:INSERT=53,cinder:UPDATE=220 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:51:20 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Volume volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 (cfe72a4f-b862-450c-9b23-2fed88d57c39): created successfully Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6004592-3581-4f56-807b-2d691851139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Flow 'volume_create_manager' (7ad1149c-eb59-4f68-b5dd-ac36710f308c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e3586051-5f91-499c-afb7-2aba4e420ef3 tempest-VolumesTransfersTest-373637741 None] Created volume successfully. Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Acquiring lock "cinder-cfe72a4f-b862-450c-9b23-2fed88d57c39-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-cfe72a4f-b862-450c-9b23-2fed88d57c39-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Acquiring lock "cinder-quobyte-cfe72a4f-b862-450c-9b23-2fed88d57c39" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-quobyte-cfe72a4f-b862-450c-9b23-2fed88d57c39" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b7b5df-22f4-4d43-a924-9c9b4633efb6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:22 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 Sep 02 00:51:22 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:22 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39" returned: 0 in 0.490s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:22 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39 Sep 02 00:51:22 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:23 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cfe72a4f-b862-450c-9b23-2fed88d57c39" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-quobyte-cfe72a4f-b862-450c-9b23-2fed88d57c39" released by "delete_volume" :: held 0.934s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Created reservations ['9a874549-c530-4eea-a946-f1a9bddb0edd', '316f693d-5820-4b43-8fe6-560ae156ef44', 'e9421e08-e756-4144-8990-b29dc8f4e1bd', '1ec40aec-aa41-40b3-ba0d-adcd72f28d22'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:23 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:23 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:23 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Deleted volume successfully. Sep 02 00:51:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f1efa6d7-2c49-427c-b54e-1e5821f76e05 tempest-VolumesTransfersTest-1575105618 None] Lock "cinder-cfe72a4f-b862-450c-9b23-2fed88d57c39-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Flow 'volume_create_manager' (b588539f-d660-4908-a509-209ab9e2f067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e4b574-88ef-4842-9555-c91804e419bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e4b574-88ef-4842-9555-c91804e419bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-351616513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6e6dc0-0c58-43b2-95f3-7b652a006281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88087b8639244e16a11d9229e2851e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:30Z,use_quota=True,user_id='5d3bdcd917284dde85ad47694b494202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85acf95f-5ae6-46ef-85da-3f4fdf87439d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85acf95f-5ae6-46ef-85da-3f4fdf87439d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6cfc91-ee65-4e00-93c9-b968ac9f56d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6cfc91-ee65-4e00-93c9-b968ac9f56d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6e6dc0-0c58-43b2-95f3-7b652a006281', 'volume_name': 'volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bc83f6-571e-4eab-84b4-cbf6b1aad334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bc83f6-571e-4eab-84b4-cbf6b1aad334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2bab20-0ccf-4477-9acb-de97f2791a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Volume 3e6e6dc0-0c58-43b2-95f3-7b652a006281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281', 'volume_size': 1} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-351616513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6e6dc0-0c58-43b2-95f3-7b652a006281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88087b8639244e16a11d9229e2851e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:30Z,use_quota=True,user_id='5d3bdcd917284dde85ad47694b494202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Creating volume 3e6e6dc0-0c58-43b2-95f3-7b652a006281 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:30 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 1073741824 Sep 02 00:51:30 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:31 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 1073741824" returned: 0 in 0.987s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:31 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 Sep 02 00:51:31 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:31 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2bab20-0ccf-4477-9acb-de97f2791a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab468350-9f8f-4042-b642-44d35b6bf622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Volume volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 (3e6e6dc0-0c58-43b2-95f3-7b652a006281): created successfully Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab468350-9f8f-4042-b642-44d35b6bf622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Flow 'volume_create_manager' (b588539f-d660-4908-a509-209ab9e2f067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-47ff66d1-d2b1-4c93-87d7-0d1b1b0e4adc tempest-VolumesTransfersV355Test-1802203962 None] Created volume successfully. Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Flow 'volume_create_manager' (3c8ebe23-59a9-4cdf-ac61-3307b7bde7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f12bfc-2b1a-4c7b-9fa6-b87356baac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f12bfc-2b1a-4c7b-9fa6-b87356baac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1665331709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54f9650-4af3-4434-adb1-8869b85bfae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef954408c0e40c189dd9b511eb28870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:32Z,use_quota=True,user_id='23829331a825499380b164cec8f9fe57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c8fe22-b6e8-485c-a4ab-19580d4c88a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c8fe22-b6e8-485c-a4ab-19580d4c88a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce6661b-41e2-4a05-94d0-fd1edc08891c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce6661b-41e2-4a05-94d0-fd1edc08891c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54f9650-4af3-4434-adb1-8869b85bfae5', 'volume_name': 'volume-e54f9650-4af3-4434-adb1-8869b85bfae5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2d45e2-80a8-4c3f-8b02-a3ec74eab5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2d45e2-80a8-4c3f-8b02-a3ec74eab5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1a8bf8-0669-43bd-b382-06dd113b2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Volume e54f9650-4af3-4434-adb1-8869b85bfae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54f9650-4af3-4434-adb1-8869b85bfae5', 'volume_size': 1} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1665331709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54f9650-4af3-4434-adb1-8869b85bfae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef954408c0e40c189dd9b511eb28870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:32Z,use_quota=True,user_id='23829331a825499380b164cec8f9fe57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Creating volume e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:32 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:32 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 1073741824 Sep 02 00:51:32 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:32 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 1073741824" returned: 0 in 0.589s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:33 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 Sep 02 00:51:33 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-27d2a1ca-534d-475f-8f42-f9b5ac2e62f6 tempest-VolumesTransfersV355Test-640471774 None] Transfer volume completed successfully. Sep 02 00:51:33 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1a8bf8-0669-43bd-b382-06dd113b2796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54f9650-4af3-4434-adb1-8869b85bfae5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5e36ec-a0fd-402e-9a33-55815854e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Volume volume-e54f9650-4af3-4434-adb1-8869b85bfae5 (e54f9650-4af3-4434-adb1-8869b85bfae5): created successfully Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5e36ec-a0fd-402e-9a33-55815854e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Flow 'volume_create_manager' (3c8ebe23-59a9-4cdf-ac61-3307b7bde7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c08ddfd5-762d-4770-ab15-01af6bb8e384 tempest-SnapshotDependencyTests-863714831 None] Created volume successfully. Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Acquiring lock "cinder-3e6e6dc0-0c58-43b2-95f3-7b652a006281-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-3e6e6dc0-0c58-43b2-95f3-7b652a006281-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Acquiring lock "cinder-quobyte-3e6e6dc0-0c58-43b2-95f3-7b652a006281" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-quobyte-3e6e6dc0-0c58-43b2-95f3-7b652a006281" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec49f5-90d7-4153-9259-c20ad9702b00]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Creating offline snapshot c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 of volume e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:51:34 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 Sep 02 00:51:34 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[685609c3-e225-4e82-8cf3-6b4b92705687]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:34 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 Sep 02 00:51:34 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:35 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281" returned: 0 in 0.668s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:35 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281 Sep 02 00:51:35 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:35 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5" returned: 0 in 0.693s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:35 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 1G Sep 02 00:51:35 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:35 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3e6e6dc0-0c58-43b2-95f3-7b652a006281" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-quobyte-3e6e6dc0-0c58-43b2-95f3-7b652a006281" released by "delete_volume" :: held 1.300s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Created reservations ['a853db41-e0d5-447a-98df-dc3109a1e19c', '504d8220-603b-4359-843e-08a02c07809a', '91fd9c4c-66a7-4c6c-9644-4b917391679f', '13d4209c-273b-4314-bd9e-75e61d9a4d06'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:35 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:35 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:36 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 1G" returned: 0 in 0.848s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54f9650-4af3-4434-adb1-8869b85bfae5 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:36 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54f9650-4af3-4434-adb1-8869b85bfae5 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 Sep 02 00:51:36 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:36 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:36 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Deleted volume successfully. Sep 02 00:51:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-521e1491-5c8e-4a99-9aac-ea9307694707 tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-3e6e6dc0-0c58-43b2-95f3-7b652a006281-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:37 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e54f9650-4af3-4434-adb1-8869b85bfae5 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" returned: 0 in 0.787s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 is being set with open permissions: ugo+rw Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:37 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 Sep 02 00:51:37 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Flow 'volume_create_manager' (52b93d76-bb2c-465f-8a26-49264a58fa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833b54f6-0577-40df-a93c-b2b64cc08ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833b54f6-0577-40df-a93c-b2b64cc08ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-702398024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8169f983-10a7-40f9-b6dc-012e9bc12fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88087b8639244e16a11d9229e2851e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:37Z,use_quota=True,user_id='5d3bdcd917284dde85ad47694b494202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26abd192-20e4-45ac-8df7-05ad71731588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26abd192-20e4-45ac-8df7-05ad71731588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4453d095-5338-4071-917d-82b8ee906fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4453d095-5338-4071-917d-82b8ee906fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8169f983-10a7-40f9-b6dc-012e9bc12fb8', 'volume_name': 'volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:37 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018f3119-9300-4301-a42f-f46dfd165bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018f3119-9300-4301-a42f-f46dfd165bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73c5103-a2db-495d-b1c6-0b9cb15f898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Volume 8169f983-10a7-40f9-b6dc-012e9bc12fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8', 'volume_size': 1} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" returned: 0 in 0.567s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:37 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.info Sep 02 00:51:37 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:37 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.info" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.info is being set with open permissions: ugo+rw Sep 02 00:51:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:37 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.info Sep 02 00:51:37 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:38 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.info" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-702398024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8169f983-10a7-40f9-b6dc-012e9bc12fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88087b8639244e16a11d9229e2851e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:37Z,use_quota=True,user_id='5d3bdcd917284dde85ad47694b494202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Creating volume 8169f983-10a7-40f9-b6dc-012e9bc12fb8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:38 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:38 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 1073741824 Sep 02 00:51:38 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ea0fbc70-a624-4a07-b6d4-fe172f3d685b tempest-SnapshotDependencyTests-863714831 None] Create snapshot completed successfully Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Flow 'volume_create_manager' (3e564b12-9a90-4a5f-9f28-5a77c7899bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348619ac-bc27-4bee-b016-0d66c53d147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348619ac-bc27-4bee-b016-0d66c53d147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1815592180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f37aff-d102-4d9e-8d44-77272e762297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9377611ae02a4f04a82f338bb23579bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:38Z,use_quota=True,user_id='b36a67c4ba32456db159b2a368ac812d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1331d3a5-f7d8-4580-9b87-42ad877db351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1331d3a5-f7d8-4580-9b87-42ad877db351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed97af4f-bf74-428f-be9b-86a665060225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed97af4f-bf74-428f-be9b-86a665060225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f37aff-d102-4d9e-8d44-77272e762297', 'volume_name': 'volume-e0f37aff-d102-4d9e-8d44-77272e762297', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b683c7-c604-491b-bcaf-691f70ba1cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b683c7-c604-491b-bcaf-691f70ba1cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d04d64-e003-4771-b787-5ae6a3e224c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Volume e0f37aff-d102-4d9e-8d44-77272e762297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f37aff-d102-4d9e-8d44-77272e762297', 'volume_size': 2} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:38 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 1073741824" returned: 0 in 0.578s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:38 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 Sep 02 00:51:38 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:39 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1815592180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f37aff-d102-4d9e-8d44-77272e762297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9377611ae02a4f04a82f338bb23579bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:38Z,use_quota=True,user_id='b36a67c4ba32456db159b2a368ac812d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Creating volume e0f37aff-d102-4d9e-8d44-77272e762297 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:39 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 2147483648 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73c5103-a2db-495d-b1c6-0b9cb15f898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:39 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 2147483648 Sep 02 00:51:39 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131b8e2d-aaf3-4bda-acc6-6fe39c4d6c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Volume volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 (8169f983-10a7-40f9-b6dc-012e9bc12fb8): created successfully Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131b8e2d-aaf3-4bda-acc6-6fe39c4d6c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Flow 'volume_create_manager' (52b93d76-bb2c-465f-8a26-49264a58fa11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9f21a2b6-43d7-4449-b8fa-dc0a7d90c91c tempest-VolumesTransfersV355Test-1802203962 None] Created volume successfully. Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Flow 'volume_create_manager' (03af1de8-fa85-4abc-bd15-8bb31e9dbecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd9d5f-e413-4a95-a194-4e76e6c398b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd9d5f-e413-4a95-a194-4e76e6c398b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3579350e-35fb-4c65-be52-4ff4e16cf34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef954408c0e40c189dd9b511eb28870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:40Z,use_quota=True,user_id='23829331a825499380b164cec8f9fe57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0571d6e6-7bb7-42f7-b64f-61004db7b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0571d6e6-7bb7-42f7-b64f-61004db7b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7223a8c2-78ad-4c81-b388-959d2f445361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7223a8c2-78ad-4c81-b388-959d2f445361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3579350e-35fb-4c65-be52-4ff4e16cf34c', 'volume_name': 'volume-3579350e-35fb-4c65-be52-4ff4e16cf34c', 'volume_size': 1, 'snapshot_id': 'c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a90a6a-defb-48c6-a6b6-112929caa542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a90a6a-defb-48c6-a6b6-112929caa542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92ab6c-f253-45fc-953e-df47893b99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Volume 3579350e-35fb-4c65-be52-4ff4e16cf34c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3579350e-35fb-4c65-be52-4ff4e16cf34c', 'volume_size': 1, 'snapshot_id': 'c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691'} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:39 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 2147483648" returned: 0 in 0.677s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:39 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 Sep 02 00:51:39 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Acquiring lock "cinder-8169f983-10a7-40f9-b6dc-012e9bc12fb8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-8169f983-10a7-40f9-b6dc-012e9bc12fb8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Acquiring lock "cinder-quobyte-8169f983-10a7-40f9-b6dc-012e9bc12fb8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-quobyte-8169f983-10a7-40f9-b6dc-012e9bc12fb8" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3c166-2f26-440c-9ece-011252984b27]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:40 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297" returned: 0 in 0.311s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.431s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-quobyte-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691-3579350e-35fb-4c65-be52-4ff4e16cf34c" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:40 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 Sep 02 00:51:40 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d04d64-e003-4771-b787-5ae6a3e224c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f37aff-d102-4d9e-8d44-77272e762297', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333ed9f1-5afe-414f-aa57-892f98d6cf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691-3579350e-35fb-4c65-be52-4ff4e16cf34c" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Creating volume 3579350e-35fb-4c65-be52-4ff4e16cf34c from snapshot c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-quobyte-3579350e-35fb-4c65-be52-4ff4e16cf34c" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Volume volume-e0f37aff-d102-4d9e-8d44-77272e762297 (e0f37aff-d102-4d9e-8d44-77272e762297): created successfully Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333ed9f1-5afe-414f-aa57-892f98d6cf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Flow 'volume_create_manager' (3e564b12-9a90-4a5f-9f28-5a77c7899bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-3579350e-35fb-4c65-be52-4ff4e16cf34c" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] snapshot: c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691, volume: 3579350e-35fb-4c65-be52-4ff4e16cf34c, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:51:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-29ffcd58-5255-452d-8155-f5e3c5cdac46 tempest-VolumesCloneNegativeTest-1659429855 None] Created volume successfully. Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f5e39-0b4b-4a7e-88be-071e76d22eb9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:40 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 Sep 02 00:51:40 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:40 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:40 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8 Sep 02 00:51:40 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:40 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" returned: 0 in 0.384s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54f9650-4af3-4434-adb1-8869b85bfae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dac315-3e85-4a99-a93c-4a21747f390e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:40 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8169f983-10a7-40f9-b6dc-012e9bc12fb8" returned: 0 in 0.287s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-quobyte-8169f983-10a7-40f9-b6dc-012e9bc12fb8" released by "delete_volume" :: held 0.809s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:40 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 Sep 02 00:51:40 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Created reservations ['fcdb17f3-c858-43a1-bb35-4b66fdcb9c7e', '07f5b9a3-ffec-49d7-b5c9-62393130fccf', '9f4a741b-4187-4625-b5f9-cb673246bfdb', '30bed6dd-2097-4df9-9635-45def30a6e92'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:41 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:41 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:41 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:41 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c Sep 02 00:51:41 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:41 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Deleted volume successfully. Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ec45d012-72a0-43cf-9eb9-4093785774dd tempest-VolumesTransfersV355Test-554665170 None] Lock "cinder-8169f983-10a7-40f9-b6dc-012e9bc12fb8-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Acquiring lock "cinder-e0f37aff-d102-4d9e-8d44-77272e762297-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "cinder-e0f37aff-d102-4d9e-8d44-77272e762297-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Acquiring lock "cinder-quobyte-e0f37aff-d102-4d9e-8d44-77272e762297" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "cinder-quobyte-e0f37aff-d102-4d9e-8d44-77272e762297" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[34994f69-c43f-4645-9898-f4fcf2c8c7bd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:42 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 Sep 02 00:51:42 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:43 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297" returned: 0 in 1.234s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:43 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297 Sep 02 00:51:43 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:43 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e0f37aff-d102-4d9e-8d44-77272e762297" returned: 0 in 0.913s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "cinder-quobyte-e0f37aff-d102-4d9e-8d44-77272e762297" released by "delete_volume" :: held 2.248s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Created reservations ['24a0416f-ebd4-46a1-a67a-0f3797339c98', '9d1524c8-e636-44c3-89e7-e8bc552d51a3', 'f104d4c9-c0ce-4b3e-be55-d11c0d90173f', 'f5e4226c-f01e-4411-be5f-cea7dfbe8012'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:44 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:44 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:45 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.789s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:45 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Deleted volume successfully. Sep 02 00:51:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-30aee78a-65d0-44fb-86b0-613b421621b8 tempest-VolumesCloneNegativeTest-1659429855 None] Lock "cinder-e0f37aff-d102-4d9e-8d44-77272e762297-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:48 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c" returned: 0 in 6.916s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:51:48 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Converted 1024.00 MB image at 148.03 MB/s Sep 02 00:51:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c is being set with open permissions: ugo+rw Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:48 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c Sep 02 00:51:48 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:48 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-3579350e-35fb-4c65-be52-4ff4e16cf34c" released by "_copy_volume_from_snapshot" :: held 8.158s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691-3579350e-35fb-4c65-be52-4ff4e16cf34c" released by "_create_volume_from_snapshot" :: held 8.250s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.295s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92ab6c-f253-45fc-953e-df47893b99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3579350e-35fb-4c65-be52-4ff4e16cf34c', 'volume_size': 1, 'snapshot_id': 'c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f470d919-6384-4765-913a-bf62d5efce02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Volume volume-3579350e-35fb-4c65-be52-4ff4e16cf34c (3579350e-35fb-4c65-be52-4ff4e16cf34c): created successfully Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f470d919-6384-4765-913a-bf62d5efce02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Flow 'volume_create_manager' (03af1de8-fa85-4abc-bd15-8bb31e9dbecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ced3f37f-e685-45c3-8a57-c2c4fe699c0e tempest-SnapshotDependencyTests-863714831 None] Created volume successfully. Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-quobyte-e54f9650-4af3-4434-adb1-8869b85bfae5" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-e54f9650-4af3-4434-adb1-8869b85bfae5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-quobyte-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Deleting offline snapshot c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 of volume e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] snapshot_file for this snap is: volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b860f16d-a676-42b0-b63c-5b1a8c566ed0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:49 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 Sep 02 00:51:49 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:49 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" returned: 0 in 0.425s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e54f9650-4af3-4434-adb1-8869b85bfae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0ec548-cd46-4393-bfd1-4466e14edcc8]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:49 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 Sep 02 00:51:49 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:50 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5" returned: 0 in 0.593s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:50 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 Sep 02 00:51:50 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:50 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" returned: 0 in 0.402s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:50 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691 Sep 02 00:51:50 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Flow 'volume_create_manager' (34df678a-e71b-4156-a6c1-16ccf44e5b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff5b073-702b-42e1-a7fa-9bf73b26678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff5b073-702b-42e1-a7fa-9bf73b26678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1184502403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b7d334-4fca-4e94-adda-a74486604b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a298d879bcfc4f2695aa84bcc69a9d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:51Z,use_quota=True,user_id='cfe15a9f14bf4c2ab5d32555d7a0bf67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdc1950-4c71-4520-a3e0-e85ac169faf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdc1950-4c71-4520-a3e0-e85ac169faf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eba2012-ab79-455d-8ef9-4c7fdb906246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eba2012-ab79-455d-8ef9-4c7fdb906246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b7d334-4fca-4e94-adda-a74486604b94', 'volume_name': 'volume-35b7d334-4fca-4e94-adda-a74486604b94', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b392fd-d024-44e7-92c9-0b1765e41730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b392fd-d024-44e7-92c9-0b1765e41730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f6aaf9-c0b3-4edb-97ee-165ed607dbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Volume 35b7d334-4fca-4e94-adda-a74486604b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b7d334-4fca-4e94-adda-a74486604b94', 'volume_size': 1} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1184502403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b7d334-4fca-4e94-adda-a74486604b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a298d879bcfc4f2695aa84bcc69a9d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:51:51Z,use_quota=True,user_id='cfe15a9f14bf4c2ab5d32555d7a0bf67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Creating volume 35b7d334-4fca-4e94-adda-a74486604b94 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:51:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:50 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 1073741824 Sep 02 00:51:50 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:50 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5.c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" returned: 0 in 0.247s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691" released by "_delete_snapshot" :: held 1.799s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-e54f9650-4af3-4434-adb1-8869b85bfae5" released by "delete_snapshot" :: held 1.828s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Created reservations ['a69073a8-a9d4-4cea-b62b-4d0cbfb4075a', 'e8a3a038-f1b8-4818-966b-618535525a9a', '94bbde6a-51f1-4441-8a82-b5112125ddfb', '84c905aa-b829-427b-8a6a-c912ddf028aa'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Delete snapshot completed successfully. Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce8fdf44-77af-4249-b62f-fc6eb9df2698 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-c1f6a70e-1ef1-4e3d-8dc6-f4fc527fe691-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-e54f9650-4af3-4434-adb1-8869b85bfae5-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-e54f9650-4af3-4434-adb1-8869b85bfae5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:51 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 1073741824" returned: 0 in 0.507s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-quobyte-e54f9650-4af3-4434-adb1-8869b85bfae5" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-e54f9650-4af3-4434-adb1-8869b85bfae5" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:51 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 Sep 02 00:51:51 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb3be59-30ed-4093-bf23-fa8923deb192]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:51 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 Sep 02 00:51:51 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:51 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94" returned: 0 in 0.279s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f6aaf9-c0b3-4edb-97ee-165ed607dbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b7d334-4fca-4e94-adda-a74486604b94', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f165bbf0-6ddd-4b7d-b338-bd1678a03e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:51:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Volume volume-35b7d334-4fca-4e94-adda-a74486604b94 (35b7d334-4fca-4e94-adda-a74486604b94): created successfully Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f165bbf0-6ddd-4b7d-b338-bd1678a03e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Flow 'volume_create_manager' (34df678a-e71b-4156-a6c1-16ccf44e5b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:51:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c5d66295-b5e3-45a3-8143-b97b7ecfa6c7 tempest-VolumesNegativeTest-1916349750 None] Created volume successfully. Sep 02 00:51:51 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:51 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5 Sep 02 00:51:51 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:52 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e54f9650-4af3-4434-adb1-8869b85bfae5" returned: 0 in 0.245s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-e54f9650-4af3-4434-adb1-8869b85bfae5" released by "delete_volume" :: held 0.687s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Created reservations ['bf20cd9e-d24c-4547-aee6-b88c3bcde1a5', '9b326429-693c-450b-a39a-aac330dd0d72', '7958cb32-f4bf-4146-b5b3-a99b45b008a0', '5ddc79df-e33b-40eb-98fa-46649397040e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:52 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:52 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-3579350e-35fb-4c65-be52-4ff4e16cf34c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-3579350e-35fb-4c65-be52-4ff4e16cf34c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:52 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Deleted volume successfully. Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ea0d994b-a3e3-4fcc-b26e-5466cb5ec90c tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-e54f9650-4af3-4434-adb1-8869b85bfae5-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "cinder-quobyte-3579350e-35fb-4c65-be52-4ff4e16cf34c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-3579350e-35fb-4c65-be52-4ff4e16cf34c" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d67088-40f4-4840-91b3-c2384b862db8]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:51:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:52 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c Sep 02 00:51:52 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:53 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c" returned: 0 in 0.415s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:53 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c Sep 02 00:51:53 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:53 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3579350e-35fb-4c65-be52-4ff4e16cf34c" returned: 0 in 0.267s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-quobyte-3579350e-35fb-4c65-be52-4ff4e16cf34c" released by "delete_volume" :: held 0.727s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Created reservations ['86541afe-69f1-42df-870e-7327eecb64a1', 'b5002041-44e4-4d56-b42f-55ef64a8d931', '259c67d0-832f-4e31-9d1b-5dba06ddbfe6', 'db7b1f1a-0e38-4f84-8def-b0c707da0610'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:51:53 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:51:53 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:51:53 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.347s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:51:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Deleted volume successfully. Sep 02 00:51:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2390170f-1859-4159-b79c-d4ac63268435 tempest-SnapshotDependencyTests-863714831 None] Lock "cinder-3579350e-35fb-4c65-be52-4ff4e16cf34c-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-b569a688-244f-455b-9d19-e2abe5e9bdee req-949262f7-bf9f-4c71-ad83-e6d70737d4fd tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-b569a688-244f-455b-9d19-e2abe5e9bdee req-949262f7-bf9f-4c71-ad83-e6d70737d4fd tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-b569a688-244f-455b-9d19-e2abe5e9bdee req-949262f7-bf9f-4c71-ad83-e6d70737d4fd tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-b569a688-244f-455b-9d19-e2abe5e9bdee req-949262f7-bf9f-4c71-ad83-e6d70737d4fd tempest-TestServerVolumeAttachmentScenario-624672231 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd6f4299-5b51-4e10-b4ce-d4d887f62672', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:52:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-b569a688-244f-455b-9d19-e2abe5e9bdee req-949262f7-bf9f-4c71-ad83-e6d70737d4fd tempest-TestServerVolumeAttachmentScenario-624672231 None] attachment_update completed successfully. Sep 02 00:52:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-ee2b2fd4-76df-42e6-97ff-1b1d257cc1cf req-a88f0169-9c87-42b2-a088-9d53efb6dd1b tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-ee2b2fd4-76df-42e6-97ff-1b1d257cc1cf req-a88f0169-9c87-42b2-a088-9d53efb6dd1b tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-ee2b2fd4-76df-42e6-97ff-1b1d257cc1cf req-a88f0169-9c87-42b2-a088-9d53efb6dd1b tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-ee2b2fd4-76df-42e6-97ff-1b1d257cc1cf req-a88f0169-9c87-42b2-a088-9d53efb6dd1b tempest-TestServerVolumeAttachmentScenario-624672231 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-65a47de7-93ab-4dbd-a589-309688d54bb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9459bc50-efcf-499a-9d65-679d8a5c2dc5', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:52:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-ee2b2fd4-76df-42e6-97ff-1b1d257cc1cf req-a88f0169-9c87-42b2-a088-9d53efb6dd1b tempest-TestServerVolumeAttachmentScenario-624672231 None] attachment_update completed successfully. Sep 02 00:52:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-7472ef20-1158-45da-be2e-e27db0eb2d75 req-29251e46-2539-47ef-9127-cb1c7367500c tempest-TestServerVolumeAttachmentScenario-624672231 None] Terminate volume connection completed successfully. Sep 02 00:52:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-7472ef20-1158-45da-be2e-e27db0eb2d75 req-29251e46-2539-47ef-9127-cb1c7367500c tempest-TestServerVolumeAttachmentScenario-624672231 None] Deleting attachment 9459bc50-efcf-499a-9d65-679d8a5c2dc5. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:12 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:52:12 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-779f04f1-516a-45f0-8362-37055a1598f3 req-bfcdd3e5-a4e6-494f-a628-fb33f6b34111 tempest-TestServerVolumeAttachmentScenario-624672231 None] Terminate volume connection completed successfully. Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-779f04f1-516a-45f0-8362-37055a1598f3 req-bfcdd3e5-a4e6-494f-a628-fb33f6b34111 tempest-TestServerVolumeAttachmentScenario-624672231 None] Deleting attachment bd6f4299-5b51-4e10-b4ce-d4d887f62672. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:52:12 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:52:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "cinder-65a47de7-93ab-4dbd-a589-309688d54bb4-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-65a47de7-93ab-4dbd-a589-309688d54bb4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "cinder-quobyte-65a47de7-93ab-4dbd-a589-309688d54bb4" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-quobyte-65a47de7-93ab-4dbd-a589-309688d54bb4" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9c0e85-cefc-497b-bd54-45a0b4ec4f83]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:19 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 Sep 02 00:52:19 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:19 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:19 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4 Sep 02 00:52:19 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:20 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-65a47de7-93ab-4dbd-a589-309688d54bb4" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-quobyte-65a47de7-93ab-4dbd-a589-309688d54bb4" released by "delete_volume" :: held 0.707s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Created reservations ['956e3638-fb92-4983-908c-719a22b5011c', '9670daea-e71b-4a38-995f-43ce2a969697', '59d273d7-9708-4ae3-a41b-4a1b10a23006', 'd73ddca8-d09c-4c4e-8c9e-f620787eb30d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:20 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:52:20 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "cinder-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "cinder-quobyte-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-quobyte-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:20 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ed93a5-93ff-436e-b298-a65ef101b9b4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:52:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Deleted volume successfully. Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=81,cinder:UPDATE=84,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:52:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-09fa9efc-33b3-462f-9e2d-b75d61ea66ba tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-65a47de7-93ab-4dbd-a589-309688d54bb4-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:20 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d Sep 02 00:52:20 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:21 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:21 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d Sep 02 00:52:21 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:21 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-quobyte-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d" released by "delete_volume" :: held 0.833s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=86,cinder:DELETE=9,cinder:SELECT=68,cinder:INSERT=23 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Created reservations ['74c265f0-af04-41d4-acaf-f2b6bffa28aa', 'a5dcdc5a-1f48-4d15-b558-2b5dc0167455', '35796a18-4a4e-4390-bce0-ce4fbe7cf185', 'f73e6d1d-9ce2-489b-87e4-38312f968da3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:21 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:52:21 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:21 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:52:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Deleted volume successfully. Sep 02 00:52:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6867cca5-3971-40e9-ab3a-87b6c5966e98 tempest-TestServerVolumeAttachmentScenario-624672231 None] Lock "cinder-6c5fa496-af6b-4ab8-8fc2-5755b7a11f7d-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Acquiring lock "cinder-35b7d334-4fca-4e94-adda-a74486604b94-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Lock "cinder-35b7d334-4fca-4e94-adda-a74486604b94-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Acquiring lock "cinder-quobyte-35b7d334-4fca-4e94-adda-a74486604b94" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Lock "cinder-quobyte-35b7d334-4fca-4e94-adda-a74486604b94" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b914125-b01e-4416-b09b-4cf30ef54c6f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:24 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 Sep 02 00:52:24 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:24 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:24 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94 Sep 02 00:52:24 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:24 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-35b7d334-4fca-4e94-adda-a74486604b94" returned: 0 in 0.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Lock "cinder-quobyte-35b7d334-4fca-4e94-adda-a74486604b94" released by "delete_volume" :: held 0.829s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Created reservations ['6507cb4a-7f26-44c7-9316-14f9273832ef', '248211ba-3676-4249-9ec6-1f5a57222bb3', 'baebcb89-05ec-41af-944f-cf1e0e05044f', 'bae483b4-5247-46fc-8c6c-20c05b3c5d41'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:24 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:52:24 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:25 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.347s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:25 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:52:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Deleted volume successfully. Sep 02 00:52:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f08cb811-5ce3-44ec-98c9-d90465eb3007 tempest-VolumesNegativeTest-1916349750 None] Lock "cinder-35b7d334-4fca-4e94-adda-a74486604b94-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Flow 'volume_create_manager' (5a5830e7-9073-4c75-8672-dbfbc0164bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ce5f3e-9a1d-41cb-b34f-801db27f1d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ce5f3e-9a1d-41cb-b34f-801db27f1d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-830351559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee7bc92-5a38-4bd7-bff2-539398426a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9bcc357dbf4bae95ff31e6fae79c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:30Z,use_quota=True,user_id='43654eba4f064b67bc68f40ed1925fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41046454-7453-4fef-a536-211f5044759e),volume_type_id=41046454-7453-4fef-a536-211f5044759e)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1334aba-dee8-4312-ab0f-b6b854904845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1334aba-dee8-4312-ab0f-b6b854904845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7b9dc0-aa60-449b-ab17-ec252a1e405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7b9dc0-aa60-449b-ab17-ec252a1e405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee7bc92-5a38-4bd7-bff2-539398426a50', 'volume_name': 'volume-bee7bc92-5a38-4bd7-bff2-539398426a50', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f2c613-7fbd-4e81-9b3f-15072ab23940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f2c613-7fbd-4e81-9b3f-15072ab23940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47253f54-9031-4917-b364-9fd4b519c0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Volume bee7bc92-5a38-4bd7-bff2-539398426a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee7bc92-5a38-4bd7-bff2-539398426a50', 'volume_size': 1} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-830351559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee7bc92-5a38-4bd7-bff2-539398426a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9bcc357dbf4bae95ff31e6fae79c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:30Z,use_quota=True,user_id='43654eba4f064b67bc68f40ed1925fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41046454-7453-4fef-a536-211f5044759e),volume_type_id=41046454-7453-4fef-a536-211f5044759e)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Creating volume bee7bc92-5a38-4bd7-bff2-539398426a50 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:52:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:30 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 1073741824 Sep 02 00:52:30 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Flow 'volume_create_manager' (8c46b785-0663-4a0c-a3ce-fcc4dfc9237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29315da0-3638-452a-bb4a-de028b794a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29315da0-3638-452a-bb4a-de028b794a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2112262787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54248113-693b-4cb0-92a9-cead266936b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9bcc357dbf4bae95ff31e6fae79c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:31Z,use_quota=True,user_id='43654eba4f064b67bc68f40ed1925fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(128df49d-f1ea-4056-8efb-e99b398207b9),volume_type_id=128df49d-f1ea-4056-8efb-e99b398207b9)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b804af87-f7b5-42ad-9c03-a1ae1ba7fa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b804af87-f7b5-42ad-9c03-a1ae1ba7fa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6270077c-365b-4889-8e6f-c75f63376352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6270077c-365b-4889-8e6f-c75f63376352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54248113-693b-4cb0-92a9-cead266936b7', 'volume_name': 'volume-54248113-693b-4cb0-92a9-cead266936b7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b7a4ab-f642-4f04-bc3b-0cbbd2307f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b7a4ab-f642-4f04-bc3b-0cbbd2307f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b54ff4-468b-4555-a296-d83dc0ae14aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Volume 54248113-693b-4cb0-92a9-cead266936b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54248113-693b-4cb0-92a9-cead266936b7', 'volume_size': 1} Sep 02 00:52:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:31 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 1073741824" returned: 0 in 0.608s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:31 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 Sep 02 00:52:31 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:31 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2112262787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54248113-693b-4cb0-92a9-cead266936b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9bcc357dbf4bae95ff31e6fae79c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:31Z,use_quota=True,user_id='43654eba4f064b67bc68f40ed1925fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(128df49d-f1ea-4056-8efb-e99b398207b9),volume_type_id=128df49d-f1ea-4056-8efb-e99b398207b9)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Creating volume 54248113-693b-4cb0-92a9-cead266936b7 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:52:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47253f54-9031-4917-b364-9fd4b519c0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee7bc92-5a38-4bd7-bff2-539398426a50', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:31 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 1073741824 Sep 02 00:52:31 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af38eeb-fda6-4af4-9e52-9c37eacbcc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Volume volume-bee7bc92-5a38-4bd7-bff2-539398426a50 (bee7bc92-5a38-4bd7-bff2-539398426a50): created successfully Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af38eeb-fda6-4af4-9e52-9c37eacbcc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Flow 'volume_create_manager' (5a5830e7-9073-4c75-8672-dbfbc0164bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-86725726-9e8e-47e7-995b-1845a897671d tempest-TestInstancesWithCinderVolumes-278512343 None] Created volume successfully. Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Flow 'volume_create_manager' (f7ad752e-4a76-491c-b6aa-908066e0cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d075eb9-33bc-4861-ae2b-b634ba91e774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d075eb9-33bc-4861-ae2b-b634ba91e774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-419593371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15943ddc-7f9e-4097-b1d8-c914d335a6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9bcc357dbf4bae95ff31e6fae79c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:32Z,use_quota=True,user_id='43654eba4f064b67bc68f40ed1925fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4e74dec-b60b-417a-84de-5616020d93e6),volume_type_id=d4e74dec-b60b-417a-84de-5616020d93e6)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab804a8-ab4b-4ab8-8356-5bb85f816cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab804a8-ab4b-4ab8-8356-5bb85f816cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea889901-2f1f-4280-8483-706ca22fac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:31 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:52:32 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 1073741824" returned: 0 in 0.650s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea889901-2f1f-4280-8483-706ca22fac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15943ddc-7f9e-4097-b1d8-c914d335a6d1', 'volume_name': 'volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1', 'volume_size': 1, 'image_id': 'd4436759-b962-4b95-8661-3b59f95d07ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4436759-b962-4b95-8661-3b59f95d07ea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--933947091', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec9bcc357dbf4bae95ff31e6fae79c54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd4436759-b962-4b95-8661-3b59f95d07ea', 'created_at': datetime.datetime(2026, 9, 1, 22, 52, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 52, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4436759-b962-4b95-8661-3b59f95d07ea/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36288e3-b185-443f-ab78-c18bdfe3f896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36288e3-b185-443f-ab78-c18bdfe3f896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b73ed4b-afe9-4e28-b052-aff7c3ea4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Volume 15943ddc-7f9e-4097-b1d8-c914d335a6d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1', 'volume_size': 1, 'image_id': 'd4436759-b962-4b95-8661-3b59f95d07ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4436759-b962-4b95-8661-3b59f95d07ea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--933947091', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec9bcc357dbf4bae95ff31e6fae79c54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd4436759-b962-4b95-8661-3b59f95d07ea', 'created_at': datetime.datetime(2026, 9, 1, 22, 52, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 52, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4436759-b962-4b95-8661-3b59f95d07ea/file', 'properties': {}}, 'image_service': } Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Trying to clone 15943ddc-7f9e-4097-b1d8-c914d335a6d1 from image d4436759-b962-4b95-8661-3b59f95d07ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/d4436759-b962-4b95-8661-3b59f95d07ea', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:32 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 Sep 02 00:52:32 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:32 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b54ff4-468b-4555-a296-d83dc0ae14aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54248113-693b-4cb0-92a9-cead266936b7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362864f6-daaa-42b0-9fb1-c24d784969b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Volume volume-54248113-693b-4cb0-92a9-cead266936b7 (54248113-693b-4cb0-92a9-cead266936b7): created successfully Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362864f6-daaa-42b0-9fb1-c24d784969b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Flow 'volume_create_manager' (8c46b785-0663-4a0c-a3ce-fcc4dfc9237d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-110ebda3-08ed-460e-9a37-aba59eb4246c tempest-TestInstancesWithCinderVolumes-278512343 None] Created volume successfully. Sep 02 00:52:36 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD, size 20.69 MB, duration 3.95 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:52:36 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Image download 20.69 MB at 5.23 MB/s Sep 02 00:52:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f1fa0-d30d-4145-a945-741110c9a0af]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:36 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD Sep 02 00:52:36 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:36 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:36 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Temporary image d4436759-b962-4b95-8661-3b59f95d07ea is fetched for user 43654eba4f064b67bc68f40ed1925fb3. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:52:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809e86f-1644-44b4-9e44-6d4881430926]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:36 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD Sep 02 00:52:36 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:37 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-419593371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15943ddc-7f9e-4097-b1d8-c914d335a6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec9bcc357dbf4bae95ff31e6fae79c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:32Z,use_quota=True,user_id='43654eba4f064b67bc68f40ed1925fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4e74dec-b60b-417a-84de-5616020d93e6),volume_type_id=d4e74dec-b60b-417a-84de-5616020d93e6)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Creating volume 15943ddc-7f9e-4097-b1d8-c914d335a6d1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:52:37 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:37 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 1073741824 Sep 02 00:52:37 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:37 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 1073741824" returned: 0 in 0.520s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:37 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 Sep 02 00:52:37 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:38 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1" returned: 0 in 0.285s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Attempting download of d4436759-b962-4b95-8661-3b59f95d07ea ((None, [{'url': 'file:///opt/stack/data/glance/images/d4436759-b962-4b95-8661-3b59f95d07ea', 'metadata': {}}])) to volume 15943ddc-7f9e-4097-b1d8-c914d335a6d1. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f9d03-b95b-46ff-a2cd-2ffaf120f3e3]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4436759-b962-4b95-8661-3b59f95d07ea_jyd88fgu {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:38 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4436759-b962-4b95-8661-3b59f95d07ea_jyd88fgu Sep 02 00:52:38 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:38 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4436759-b962-4b95-8661-3b59f95d07ea_jyd88fgu" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4436759-b962-4b95-8661-3b59f95d07ea_jyd88fgu {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:38 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4436759-b962-4b95-8661-3b59f95d07ea_jyd88fgu Sep 02 00:52:38 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:38 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4436759-b962-4b95-8661-3b59f95d07ea_jyd88fgu" returned: 1 in 0.432s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4436759-b962-4b95-8661-3b59f95d07ea_jyd88fgu' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ffb8a7-860c-402f-8409-57a0805cfe6d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:39 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD Sep 02 00:52:39 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:39 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] d4436759-b962-4b95-8661-3b59f95d07ea was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:39 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 Sep 02 00:52:39 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (5f41db2f-3719-4893-9baa-887ec9e7a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14235f8b-698b-4399-a8a4-8f2790d3a0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14235f8b-698b-4399-a8a4-8f2790d3a0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1483179226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd971b05-c5e5-461a-bc1f-d793dec4e28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:39Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dabca5-70fc-41bf-b158-1b271c983482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dabca5-70fc-41bf-b158-1b271c983482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74271ed2-96fb-4eac-8ad4-0d04b766a494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74271ed2-96fb-4eac-8ad4-0d04b766a494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd971b05-c5e5-461a-bc1f-d793dec4e28d', 'volume_name': 'volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f62d184-979e-4a6f-af70-a42bfd71f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f62d184-979e-4a6f-af70-a42bfd71f39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb1b969-d825-4fe7-8324-0493aade04d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Volume bd971b05-c5e5-461a-bc1f-d793dec4e28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d', 'volume_size': 1} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1483179226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd971b05-c5e5-461a-bc1f-d793dec4e28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:39Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Creating volume bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:52:39 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:52:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:39 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d 1073741824 Sep 02 00:52:39 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:40 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d 1073741824" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:40 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d Sep 02 00:52:40 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:40 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb1b969-d825-4fe7-8324-0493aade04d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3dceb9-0526-499c-aabf-a3a518409114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Volume volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d (bd971b05-c5e5-461a-bc1f-d793dec4e28d): created successfully Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3dceb9-0526-499c-aabf-a3a518409114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (5f41db2f-3719-4893-9baa-887ec9e7a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-43b64162-a4fc-4f31-95e1-8878b59aa7e6 tempest-VolumesSnapshotTestJSON-1181333694 None] Created volume successfully. Sep 02 00:52:41 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1" returned: 0 in 1.886s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d4436759-b962-4b95-8661-3b59f95d07ea_b27jzdfydevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:52:41 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Converted 112.00 MB image at 59.35 MB/s Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:41 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 1G Sep 02 00:52:41 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:41 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 1G" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Downloaded image d4436759-b962-4b95-8661-3b59f95d07ea ((None, [{'url': 'file:///opt/stack/data/glance/images/d4436759-b962-4b95-8661-3b59f95d07ea', 'metadata': {}}])) to volume 15943ddc-7f9e-4097-b1d8-c914d335a6d1 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Temporary image d4436759-b962-4b95-8661-3b59f95d07ea for user 43654eba4f064b67bc68f40ed1925fb3 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Marking volume 15943ddc-7f9e-4097-b1d8-c914d335a6d1 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Copying metadata from image d4436759-b962-4b95-8661-3b59f95d07ea to 15943ddc-7f9e-4097-b1d8-c914d335a6d1. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Creating volume glance metadata for volume 15943ddc-7f9e-4097-b1d8-c914d335a6d1 backed by image d4436759-b962-4b95-8661-3b59f95d07ea with: {'image_id': 'd4436759-b962-4b95-8661-3b59f95d07ea', 'image_name': 'tempest-scenario-img--933947091', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Creating offline snapshot 90203bc2-f9fc-4d13-bcbf-6800abda8f18 of volume bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020b8e3-6242-44be-b57f-e372cf92d94c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b73ed4b-afe9-4e28-b052-aff7c3ea4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1', 'volume_size': 1, 'image_id': 'd4436759-b962-4b95-8661-3b59f95d07ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4436759-b962-4b95-8661-3b59f95d07ea', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--933947091', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec9bcc357dbf4bae95ff31e6fae79c54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd4436759-b962-4b95-8661-3b59f95d07ea', 'created_at': datetime.datetime(2026, 9, 1, 22, 52, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 52, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4436759-b962-4b95-8661-3b59f95d07ea/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3191752d-f8d4-467b-a78d-d337abd177cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Volume volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 (15943ddc-7f9e-4097-b1d8-c914d335a6d1): created successfully Sep 02 00:52:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3191752d-f8d4-467b-a78d-d337abd177cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Flow 'volume_create_manager' (f7ad752e-4a76-491c-b6aa-908066e0cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7cc649fc-48a9-45cf-acc7-dd068e789bb6 tempest-TestInstancesWithCinderVolumes-278512343 None] Created volume successfully. Sep 02 00:52:42 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d Sep 02 00:52:42 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:42 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:42 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 1G Sep 02 00:52:42 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:42 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 1G" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:42 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 Sep 02 00:52:42 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:43 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:43 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 is being set with open permissions: ugo+rw Sep 02 00:52:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:43 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 Sep 02 00:52:43 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:43 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:43 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.info Sep 02 00:52:43 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:43 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.info" returned: 0 in 0.343s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:43 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.info is being set with open permissions: ugo+rw Sep 02 00:52:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:43 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.info Sep 02 00:52:43 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:44 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.info" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bc1b6def-90fd-4f0e-a00c-6565a78768f8 tempest-VolumesSnapshotTestJSON-1181333694 None] Create snapshot completed successfully Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-90203bc2-f9fc-4d13-bcbf-6800abda8f18-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-90203bc2-f9fc-4d13-bcbf-6800abda8f18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-bd971b05-c5e5-461a-bc1f-d793dec4e28d" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-bd971b05-c5e5-461a-bc1f-d793dec4e28d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-90203bc2-f9fc-4d13-bcbf-6800abda8f18" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-90203bc2-f9fc-4d13-bcbf-6800abda8f18" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Deleting offline snapshot 90203bc2-f9fc-4d13-bcbf-6800abda8f18 of volume bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] snapshot_file for this snap is: volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[137b6a65-8d79-461a-b8f1-b0ba8a8ce514]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:45 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 Sep 02 00:52:45 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-9bbc592b-76e7-4325-a40e-78d4e2e47f2e req-43e5f336-bac0-4fba-bb13-80d4790f8d3c tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-9bbc592b-76e7-4325-a40e-78d4e2e47f2e req-43e5f336-bac0-4fba-bb13-80d4790f8d3c tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-9bbc592b-76e7-4325-a40e-78d4e2e47f2e req-43e5f336-bac0-4fba-bb13-80d4790f8d3c tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-9bbc592b-76e7-4325-a40e-78d4e2e47f2e req-43e5f336-bac0-4fba-bb13-80d4790f8d3c tempest-TestInstancesWithCinderVolumes-278512343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c25cfe0b-a65f-486d-9522-eccb1228273f', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:52:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-9bbc592b-76e7-4325-a40e-78d4e2e47f2e req-43e5f336-bac0-4fba-bb13-80d4790f8d3c tempest-TestInstancesWithCinderVolumes-278512343 None] attachment_update completed successfully. Sep 02 00:52:45 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18" returned: 0 in 0.491s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f73fee-b169-4a29-b3ed-aea50cf5b1c2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:46 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d Sep 02 00:52:46 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:46 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:46 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 Sep 02 00:52:46 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:46 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:46 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18 Sep 02 00:52:46 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:47 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d.90203bc2-f9fc-4d13-bcbf-6800abda8f18" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-90203bc2-f9fc-4d13-bcbf-6800abda8f18" released by "_delete_snapshot" :: held 1.836s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-bd971b05-c5e5-461a-bc1f-d793dec4e28d" released by "delete_snapshot" :: held 1.870s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:47 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['569ad4ce-5ab2-4724-932b-838b0eea23b1', 'aeb94aef-9a0d-4a69-900e-98fe8c39bb1d', 'fef06f22-7fdc-4920-b9bb-21f8116dadac', 'f349d951-da69-46df-90ab-5ab351b5a80a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:52:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Delete snapshot completed successfully. Sep 02 00:52:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-78f8d797-fba4-4676-8332-326cd607f814 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-90203bc2-f9fc-4d13-bcbf-6800abda8f18-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (9bee89dc-dc91-4cff-a9a9-79814b94798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ce9d38-14d8-49fe-a588-20052fd5dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ce9d38-14d8-49fe-a588-20052fd5dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-741187252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07153b24-8eaa-4604-bd67-2684e380433a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:49Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb8808b-21ab-4469-b545-277c272aa168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb8808b-21ab-4469-b545-277c272aa168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f440bce-b6f2-48a7-8ffa-49a1335810ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f440bce-b6f2-48a7-8ffa-49a1335810ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07153b24-8eaa-4604-bd67-2684e380433a', 'volume_name': 'volume-07153b24-8eaa-4604-bd67-2684e380433a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845747a2-5b5e-4286-8cbc-ee71d345b533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845747a2-5b5e-4286-8cbc-ee71d345b533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d078216d-19e8-4414-bebb-9842dc5979bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Volume 07153b24-8eaa-4604-bd67-2684e380433a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07153b24-8eaa-4604-bd67-2684e380433a', 'volume_size': 1} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-741187252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07153b24-8eaa-4604-bd67-2684e380433a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:49Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Creating volume 07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:52:49 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:52:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:49 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a 1073741824 Sep 02 00:52:49 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:50 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a 1073741824" returned: 0 in 0.790s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:50 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a Sep 02 00:52:50 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:50 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d078216d-19e8-4414-bebb-9842dc5979bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07153b24-8eaa-4604-bd67-2684e380433a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1473d0d2-23c8-4bf7-9396-9dccce20cae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Volume volume-07153b24-8eaa-4604-bd67-2684e380433a (07153b24-8eaa-4604-bd67-2684e380433a): created successfully Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1473d0d2-23c8-4bf7-9396-9dccce20cae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (9bee89dc-dc91-4cff-a9a9-79814b94798f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-98f5d1cd-2426-4f39-94cf-2b83e1823f6f tempest-VolumesSnapshotTestJSON-1181333694 None] Created volume successfully. Sep 02 00:52:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Creating offline snapshot 1ec73c6b-2dbd-493f-bf71-2c91437f1d98 of volume 07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:52:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[97312d40-9191-4880-b313-57bc3b81599d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:51 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a Sep 02 00:52:51 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:52 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:52 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 1G Sep 02 00:52:52 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:52 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 1G" returned: 0 in 0.586s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07153b24-8eaa-4604-bd67-2684e380433a -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:52 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07153b24-8eaa-4604-bd67-2684e380433a -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 Sep 02 00:52:52 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:53 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07153b24-8eaa-4604-bd67-2684e380433a -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98" returned: 0 in 0.515s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:53 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 is being set with open permissions: ugo+rw Sep 02 00:52:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:53 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 Sep 02 00:52:53 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:53 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98" returned: 0 in 0.348s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:53 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.info Sep 02 00:52:53 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:54 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.info" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:54 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.info is being set with open permissions: ugo+rw Sep 02 00:52:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:54 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.info Sep 02 00:52:54 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:54 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.info" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.929s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-00ce3536-6d4c-4415-a08e-6ae37af4f63a tempest-VolumesSnapshotTestJSON-1181333694 None] Create snapshot completed successfully Sep 02 00:52:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:52:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (851fab90-aa46-40ea-adde-6e90d8e45fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:52:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625b13a8-ccee-4516-8fbe-bcca3c4ee6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625b13a8-ccee-4516-8fbe-bcca3c4ee6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-92581603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7fc505-4061-4a1f-baeb-6c65448b8cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:52:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1ec73c6b-2dbd-493f-bf71-2c91437f1d98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:52:56Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d215f-01ac-4a49-bc23-7f8d0e99a6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51d215f-01ac-4a49-bc23-7f8d0e99a6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1332918b-6c56-4b44-8ae3-c67293848bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1332918b-6c56-4b44-8ae3-c67293848bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ff7fc505-4061-4a1f-baeb-6c65448b8cc9', 'volume_name': 'volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9', 'volume_size': 2, 'snapshot_id': '1ec73c6b-2dbd-493f-bf71-2c91437f1d98'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f595a7cb-ce4b-4431-8592-bb57af9c9c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f595a7cb-ce4b-4431-8592-bb57af9c9c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b582a44-7293-4e85-aab5-b8896f82dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:52:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Volume ff7fc505-4061-4a1f-baeb-6c65448b8cc9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9', 'volume_size': 2, 'snapshot_id': '1ec73c6b-2dbd-493f-bf71-2c91437f1d98'} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-1ec73c6b-2dbd-493f-bf71-2c91437f1d98-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-1ec73c6b-2dbd-493f-bf71-2c91437f1d98-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Creating volume ff7fc505-4061-4a1f-baeb-6c65448b8cc9 from snapshot 1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] snapshot: 1ec73c6b-2dbd-493f-bf71-2c91437f1d98, volume: ff7fc505-4061-4a1f-baeb-6c65448b8cc9, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea48411f-1cba-4679-801b-f9af0568af36]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:56 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 Sep 02 00:52:56 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:56 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98" returned: 0 in 0.598s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07153b24-8eaa-4604-bd67-2684e380433a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7492a7-7719-4ac8-9e74-93ec1094fa9b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:52:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:57 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a Sep 02 00:52:57 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:52:57 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 02 00:52:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:52:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:52:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:52:57 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:52:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:52:57 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 Sep 02 00:52:57 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:03 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" returned: 0 in 6.649s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:03 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:53:03 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Converted 1024.00 MB image at 153.98 MB/s Sep 02 00:53:03 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 is being set with open permissions: ugo+rw Sep 02 00:53:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:04 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 Sep 02 00:53:04 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:04 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" released by "_copy_volume_from_snapshot" :: held 8.268s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-1ec73c6b-2dbd-493f-bf71-2c91437f1d98-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" released by "_create_volume_from_snapshot" :: held 8.403s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.419s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b582a44-7293-4e85-aab5-b8896f82dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9', 'volume_size': 2, 'snapshot_id': '1ec73c6b-2dbd-493f-bf71-2c91437f1d98'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba516c92-bd3c-4257-93ff-9445f75b620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Volume volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 (ff7fc505-4061-4a1f-baeb-6c65448b8cc9): created successfully Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba516c92-bd3c-4257-93ff-9445f75b620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (851fab90-aa46-40ea-adde-6e90d8e45fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:53:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6a9941fb-d998-431a-8959-c2edae628e5f tempest-VolumesSnapshotTestJSON-1181333694 None] Created volume successfully. Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-ff7fc505-4061-4a1f-baeb-6c65448b8cc9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-ff7fc505-4061-4a1f-baeb-6c65448b8cc9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cbd8ab-ff67-437b-96c6-90007a56ba4a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:05 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 Sep 02 00:53:05 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:05 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" returned: 0 in 0.432s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:05 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9 Sep 02 00:53:05 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:06 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" returned: 0 in 0.283s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-ff7fc505-4061-4a1f-baeb-6c65448b8cc9" released by "delete_volume" :: held 0.788s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['65b78d84-b1d2-469d-b48b-c422c536527e', '38c46826-18fa-406c-aa2b-2f5598845110', '69d613ec-05e2-4915-a392-097359df4923', '06fde2bc-eace-4416-82fc-f3feb875a7f6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:06 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:06 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-1ec73c6b-2dbd-493f-bf71-2c91437f1d98-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-1ec73c6b-2dbd-493f-bf71-2c91437f1d98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-07153b24-8eaa-4604-bd67-2684e380433a" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-07153b24-8eaa-4604-bd67-2684e380433a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-1ec73c6b-2dbd-493f-bf71-2c91437f1d98" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-1ec73c6b-2dbd-493f-bf71-2c91437f1d98" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Deleting offline snapshot 1ec73c6b-2dbd-493f-bf71-2c91437f1d98 of volume 07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] snapshot_file for this snap is: volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:53:06 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.574s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Deleted volume successfully. Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51e1b2-12f4-454e-a74d-6b718541eab2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-908f30a3-c127-4aa1-a992-d73283f5ec25 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-ff7fc505-4061-4a1f-baeb-6c65448b8cc9-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:07 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 Sep 02 00:53:07 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:07 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07153b24-8eaa-4604-bd67-2684e380433a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:53:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e039d85-4530-473d-ac42-b94d0a0bf5c6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:07 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a Sep 02 00:53:07 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:07 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a" returned: 0 in 0.543s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:07 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 Sep 02 00:53:07 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:08 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98" returned: 0 in 0.398s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:08 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98 Sep 02 00:53:08 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:08 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a.1ec73c6b-2dbd-493f-bf71-2c91437f1d98" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-1ec73c6b-2dbd-493f-bf71-2c91437f1d98" released by "_delete_snapshot" :: held 1.828s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-07153b24-8eaa-4604-bd67-2684e380433a" released by "delete_snapshot" :: held 1.860s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:12 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:12 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:12 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.250s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:53:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:53:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['ac025335-cbf3-484e-bc0b-0c049ae2bd6a', 'c339de62-d1ae-4ad4-a2c7-57c6a3db8cbf', '77f7e3fb-de6c-4b64-a5cc-d123c41b906b', '9ee59815-a8c3-417c-93cd-4430e7ed8a24'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Delete snapshot completed successfully. Sep 02 00:53:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-eb3aa145-61d1-41e6-b254-7dc6d8e3e410 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-1ec73c6b-2dbd-493f-bf71-2c91437f1d98-delete_snapshot" released by "delete_snapshot" :: held 7.426s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-07153b24-8eaa-4604-bd67-2684e380433a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-07153b24-8eaa-4604-bd67-2684e380433a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-07153b24-8eaa-4604-bd67-2684e380433a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-07153b24-8eaa-4604-bd67-2684e380433a" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[41965cb9-0d16-4c05-ac1a-f9fff0f02809]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:15 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a Sep 02 00:53:15 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:15 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a" returned: 0 in 0.397s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:15 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a Sep 02 00:53:15 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:15 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-07153b24-8eaa-4604-bd67-2684e380433a" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-07153b24-8eaa-4604-bd67-2684e380433a" released by "delete_volume" :: held 0.719s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['4fff5c53-d4d6-447c-81d2-d6c66c3ff0ac', '7bf2b3dd-2e5d-415d-9947-a8b5c4e42328', '8f5470af-258c-4a09-928e-8f230be26295', '7e7db140-1ac0-4a86-8d88-122966bdad97'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:16 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:16 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:16 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.317s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Deleted volume successfully. Sep 02 00:53:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5423af9d-f295-410a-9981-ce88ff8d3c4c tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-07153b24-8eaa-4604-bd67-2684e380433a-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (35a6dcac-8ea4-43a3-8296-1d0b02d0b52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39aab6af-0254-464e-a0da-1b043ad5ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39aab6af-0254-464e-a0da-1b043ad5ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-394459254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9d9b49-afcf-4711-8a46-3ac454420581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:53:17Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc4c00a-78a7-4f21-87b0-1f141cdd6af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc4c00a-78a7-4f21-87b0-1f141cdd6af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285a1caf-ab84-4232-adad-17c9e4c977af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285a1caf-ab84-4232-adad-17c9e4c977af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9d9b49-afcf-4711-8a46-3ac454420581', 'volume_name': 'volume-cf9d9b49-afcf-4711-8a46-3ac454420581', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ccef64-959a-417e-a9f0-8287d05372b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ccef64-959a-417e-a9f0-8287d05372b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ee555c-b5a0-4126-91bd-f5689e76e09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Volume cf9d9b49-afcf-4711-8a46-3ac454420581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9d9b49-afcf-4711-8a46-3ac454420581', 'volume_size': 1} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-394459254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9d9b49-afcf-4711-8a46-3ac454420581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:53:17Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Creating volume cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:53:17 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:17 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 1073741824 Sep 02 00:53:17 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:17 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 1073741824" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:17 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 Sep 02 00:53:17 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:18 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581" returned: 0 in 0.278s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ee555c-b5a0-4126-91bd-f5689e76e09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9d9b49-afcf-4711-8a46-3ac454420581', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81ffc65-81df-4a4d-af29-0b578a1db1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Volume volume-cf9d9b49-afcf-4711-8a46-3ac454420581 (cf9d9b49-afcf-4711-8a46-3ac454420581): created successfully Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81ffc65-81df-4a4d-af29-0b578a1db1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (35a6dcac-8ea4-43a3-8296-1d0b02d0b52a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:53:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a80c09b5-e572-4600-9736-6355261ba3b7 tempest-VolumesSnapshotTestJSON-1181333694 None] Created volume successfully. Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Flow 'volume_create_manager' (5250b0bf-2ee9-427a-90c2-4b31e69affc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4b1f3c-6f76-4905-bc4a-5298bf77c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4b1f3c-6f76-4905-bc4a-5298bf77c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-893349865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccf404e-a1e9-4520-b49e-78f8f0f0d426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3420322e44247f59cc488f0a1f112c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:53:18Z,use_quota=True,user_id='229dbae30df148fca22044e1116856f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489cf5e7-e3aa-4cd7-bb87-bd314ee0ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489cf5e7-e3aa-4cd7-bb87-bd314ee0ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d2dba3-beb7-4e3b-8263-2b6498b2c814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d2dba3-beb7-4e3b-8263-2b6498b2c814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ccf404e-a1e9-4520-b49e-78f8f0f0d426', 'volume_name': 'volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5eaa15-d9d4-4579-8273-d95e135d9914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5eaa15-d9d4-4579-8273-d95e135d9914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc53349f-3b09-41fa-993f-43274308360e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Volume 4ccf404e-a1e9-4520-b49e-78f8f0f0d426: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 02 00:53:18 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Trying to clone 4ccf404e-a1e9-4520-b49e-78f8f0f0d426 from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:53:19 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Image download 20.69 MB at 20.69 MB/s Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e2e72a-30e6-41e0-a6f0-d3d57dc08ed3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Creating offline snapshot 850fd8ac-72ab-4498-bf22-ff973fbf1830 of volume cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:53:19 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD Sep 02 00:53:19 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d9d123-72b9-4320-a7d1-99da5c17bb74]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:19 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 Sep 02 00:53:19 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:19 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 is fetched for user 229dbae30df148fca22044e1116856f5. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[20762b89-1757-4295-bb0c-19b489de985e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:19 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581" returned: 0 in 0.377s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:19 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD Sep 02 00:53:19 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:19 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 1G Sep 02 00:53:19 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:20 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:20 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 1G" returned: 0 in 0.397s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9d9b49-afcf-4711-8a46-3ac454420581 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:20 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9d9b49-afcf-4711-8a46-3ac454420581 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 Sep 02 00:53:20 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:20 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9d9b49-afcf-4711-8a46-3ac454420581 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830" returned: 0 in 0.295s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:20 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 is being set with open permissions: ugo+rw Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:20 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 Sep 02 00:53:20 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:20 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=83,cinder:INSERT=23,cinder:UPDATE=79,cinder:DELETE=8 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:53:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:20 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.info Sep 02 00:53:20 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:21 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.info" returned: 0 in 0.268s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:21 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.info is being set with open permissions: ugo+rw Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:21 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.info Sep 02 00:53:21 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:21 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.info" returned: 0 in 0.247s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.260s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-893349865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ccf404e-a1e9-4520-b49e-78f8f0f0d426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3420322e44247f59cc488f0a1f112c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:53:18Z,use_quota=True,user_id='229dbae30df148fca22044e1116856f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Creating volume 4ccf404e-a1e9-4520-b49e-78f8f0f0d426 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:53:21 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:21 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 1073741824 Sep 02 00:53:21 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9c1295ce-c863-4bcb-93ef-7cad6601c6d3 tempest-VolumesSnapshotTestJSON-1181333694 None] Create snapshot completed successfully Sep 02 00:53:21 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 1073741824" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:INSERT=22,cinder:UPDATE=66,cinder:SELECT=69,cinder:DELETE=5 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:53:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:21 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 Sep 02 00:53:21 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:22 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (bef76163-5387-40b6-afad-c5f2de2766f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e328aa-915e-49d7-814b-42f6fd89890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e328aa-915e-49d7-814b-42f6fd89890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-411931334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ed7c2f-9ca1-4fdf-a166-3676a837056f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863404368ec94fecb41fc0b22015aca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=850fd8ac-72ab-4498-bf22-ff973fbf1830,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:53:22Z,use_quota=True,user_id='d36536992f8c4b72bc99fb300891a730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600d70b1-5808-4b93-8b8f-8fccac7cbf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600d70b1-5808-4b93-8b8f-8fccac7cbf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fad5e9-d8fb-452f-ad3b-6c6a8ad5662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fad5e9-d8fb-452f-ad3b-6c6a8ad5662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23ed7c2f-9ca1-4fdf-a166-3676a837056f', 'volume_name': 'volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f', 'volume_size': 1, 'snapshot_id': '850fd8ac-72ab-4498-bf22-ff973fbf1830'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c964fe-d2d5-4330-a922-9de5c57dca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c964fe-d2d5-4330-a922-9de5c57dca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1651baa-81a7-438a-a396-7a5b0dbdf90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Volume 23ed7c2f-9ca1-4fdf-a166-3676a837056f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f', 'volume_size': 1, 'snapshot_id': '850fd8ac-72ab-4498-bf22-ff973fbf1830'} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Attempting download of 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume 4ccf404e-a1e9-4520-b49e-78f8f0f0d426. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-850fd8ac-72ab-4498-bf22-ff973fbf1830-23ed7c2f-9ca1-4fdf-a166-3676a837056f" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-850fd8ac-72ab-4498-bf22-ff973fbf1830-23ed7c2f-9ca1-4fdf-a166-3676a837056f" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Creating volume 23ed7c2f-9ca1-4fdf-a166-3676a837056f from snapshot 850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-23ed7c2f-9ca1-4fdf-a166-3676a837056f" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7b49cb-eeab-46ee-bb22-1965dbef1889]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_lt1w8m9p {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-23ed7c2f-9ca1-4fdf-a166-3676a837056f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] snapshot: 850fd8ac-72ab-4498-bf22-ff973fbf1830, volume: 23ed7c2f-9ca1-4fdf-a166-3676a837056f, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[33760dc6-da83-4d95-9844-145721ac7018]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:22 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_lt1w8m9p Sep 02 00:53:22 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:22 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 Sep 02 00:53:22 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:22 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_lt1w8m9p" returned: 0 in 0.379s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_lt1w8m9p {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:22 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9d9b49-afcf-4711-8a46-3ac454420581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[459e0e8f-0231-435c-8e4c-7045459ff6e0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:22 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_lt1w8m9p Sep 02 00:53:22 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:22 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 Sep 02 00:53:22 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:23 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_lt1w8m9p" returned: 1 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55fd1d9e-80e7-4ee4-bf99-467853787b78_lt1w8m9p' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cbb312-bd71-4d8e-be26-7595a2d89163]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:23 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:23 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD Sep 02 00:53:23 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:23 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f Sep 02 00:53:23 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:23 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] 55fd1d9e-80e7-4ee4-bf99-467853787b78 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:53:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:23 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 Sep 02 00:53:23 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-7cb543e1-9e57-499f-9b35-6ba45cd522c7 req-f00acd9f-63a1-4c85-90d7-0194918ae161 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:27 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426" returned: 0 in 3.822s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:27 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55fd1d9e-80e7-4ee4-bf99-467853787b78_prz1k9azdevstack@QuobyteHD, size 112.00 MB, duration 3.82 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:53:27 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Converted 112.00 MB image at 29.29 MB/s Sep 02 00:53:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:27 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 1G Sep 02 00:53:27 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:28 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 1G" returned: 0 in 0.776s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Downloaded image 55fd1d9e-80e7-4ee4-bf99-467853787b78 ((None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}])) to volume 4ccf404e-a1e9-4520-b49e-78f8f0f0d426 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Temporary image 55fd1d9e-80e7-4ee4-bf99-467853787b78 for user 229dbae30df148fca22044e1116856f5 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Marking volume 4ccf404e-a1e9-4520-b49e-78f8f0f0d426 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Copying metadata from image 55fd1d9e-80e7-4ee4-bf99-467853787b78 to 4ccf404e-a1e9-4520-b49e-78f8f0f0d426. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Creating volume glance metadata for volume 4ccf404e-a1e9-4520-b49e-78f8f0f0d426 backed by image 55fd1d9e-80e7-4ee4-bf99-467853787b78 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:53:28 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f" returned: 0 in 5.017s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:53:28 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Converted 1024.00 MB image at 204.07 MB/s Sep 02 00:53:28 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f is being set with open permissions: ugo+rw Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:28 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f Sep 02 00:53:28 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc53349f-3b09-41fa-993f-43274308360e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426', 'volume_size': 1, 'image_id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55fd1d9e-80e7-4ee4-bf99-467853787b78', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'be9d4d21d2014d5ba579f5451d716471', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55fd1d9e-80e7-4ee4-bf99-467853787b78', 'created_at': datetime.datetime(2026, 9, 1, 22, 33, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 33, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55fd1d9e-80e7-4ee4-bf99-467853787b78/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e236dc6-6777-4009-9f13-62371d8af949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Volume volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 (4ccf404e-a1e9-4520-b49e-78f8f0f0d426): created successfully Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e236dc6-6777-4009-9f13-62371d8af949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Flow 'volume_create_manager' (5250b0bf-2ee9-427a-90c2-4b31e69affc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:53:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dcb75813-6390-4a59-9324-e7dfdb03d032 tempest-TestShelveInstance-83868739 None] Created volume successfully. Sep 02 00:53:28 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f" returned: 0 in 0.247s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-23ed7c2f-9ca1-4fdf-a166-3676a837056f" released by "_copy_volume_from_snapshot" :: held 6.160s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-850fd8ac-72ab-4498-bf22-ff973fbf1830-23ed7c2f-9ca1-4fdf-a166-3676a837056f" released by "_create_volume_from_snapshot" :: held 6.233s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.253s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-7cb543e1-9e57-499f-9b35-6ba45cd522c7 req-f00acd9f-63a1-4c85-90d7-0194918ae161 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.391s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-7cb543e1-9e57-499f-9b35-6ba45cd522c7 req-f00acd9f-63a1-4c85-90d7-0194918ae161 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1651baa-81a7-438a-a396-7a5b0dbdf90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f', 'volume_size': 1, 'snapshot_id': '850fd8ac-72ab-4498-bf22-ff973fbf1830'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1fffdf-5846-486a-87a8-1e8376483079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:53:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Volume volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f (23ed7c2f-9ca1-4fdf-a166-3676a837056f): created successfully Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1fffdf-5846-486a-87a8-1e8376483079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Flow 'volume_create_manager' (bef76163-5387-40b6-afad-c5f2de2766f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-7cb543e1-9e57-499f-9b35-6ba45cd522c7 req-f00acd9f-63a1-4c85-90d7-0194918ae161 tempest-TestInstancesWithCinderVolumes-278512343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-bee7bc92-5a38-4bd7-bff2-539398426a50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb8e7728-261c-4dde-bbc0-082520d8ff4e', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:53:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7476d77d-762c-4e2c-a0b0-aac0102d84cd tempest-VolumesSnapshotTestJSON-1181333694 None] Created volume successfully. Sep 02 00:53:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-7cb543e1-9e57-499f-9b35-6ba45cd522c7 req-f00acd9f-63a1-4c85-90d7-0194918ae161 tempest-TestInstancesWithCinderVolumes-278512343 None] attachment_update completed successfully. Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-23ed7c2f-9ca1-4fdf-a166-3676a837056f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-23ed7c2f-9ca1-4fdf-a166-3676a837056f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-23ed7c2f-9ca1-4fdf-a166-3676a837056f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-23ed7c2f-9ca1-4fdf-a166-3676a837056f" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251d104-a1bf-419c-bbbf-fbcf4c1cfafa]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:29 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f Sep 02 00:53:29 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:29 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f" returned: 0 in 0.380s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:29 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f Sep 02 00:53:29 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:29 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23ed7c2f-9ca1-4fdf-a166-3676a837056f" returned: 0 in 0.247s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-23ed7c2f-9ca1-4fdf-a166-3676a837056f" released by "delete_volume" :: held 0.679s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['49d53573-6ce8-48c0-9b7e-7c34c002b160', '0a164fe7-f484-439b-8317-a46462db462c', 'ba0455db-e609-4e97-acab-88478986ec65', '1032152f-f196-482b-a6f6-5430f2fc3879'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:29 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:29 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:30 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Deleted volume successfully. Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2530f1eb-5727-4d93-ad45-ae28eecdbbeb tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-23ed7c2f-9ca1-4fdf-a166-3676a837056f-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-850fd8ac-72ab-4498-bf22-ff973fbf1830-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-850fd8ac-72ab-4498-bf22-ff973fbf1830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-cf9d9b49-afcf-4711-8a46-3ac454420581" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-cf9d9b49-afcf-4711-8a46-3ac454420581" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-850fd8ac-72ab-4498-bf22-ff973fbf1830" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-850fd8ac-72ab-4498-bf22-ff973fbf1830" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Deleting offline snapshot 850fd8ac-72ab-4498-bf22-ff973fbf1830 of volume cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] snapshot_file for this snap is: volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfae621-663a-42bb-8007-3a7ac868dfed]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:30 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 Sep 02 00:53:30 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:30 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9d9b49-afcf-4711-8a46-3ac454420581(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f71f0-8cc9-4228-872a-5537a6283fad]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:30 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 Sep 02 00:53:30 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-322b71db-ebd1-432d-a340-a4dd63e7112e req-c9055b0b-4ab7-42e6-849d-ee0181ba1171 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-322b71db-ebd1-432d-a340-a4dd63e7112e req-c9055b0b-4ab7-42e6-849d-ee0181ba1171 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-322b71db-ebd1-432d-a340-a4dd63e7112e req-c9055b0b-4ab7-42e6-849d-ee0181ba1171 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-322b71db-ebd1-432d-a340-a4dd63e7112e req-c9055b0b-4ab7-42e6-849d-ee0181ba1171 tempest-TestInstancesWithCinderVolumes-278512343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-54248113-693b-4cb0-92a9-cead266936b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61681b2e-d387-4ad8-835c-9301d04cf72f', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:53:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-322b71db-ebd1-432d-a340-a4dd63e7112e req-c9055b0b-4ab7-42e6-849d-ee0181ba1171 tempest-TestInstancesWithCinderVolumes-278512343 None] attachment_update completed successfully. Sep 02 00:53:31 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581" returned: 0 in 0.615s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:31 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 Sep 02 00:53:31 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:31 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830" returned: 0 in 0.448s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:31 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830 Sep 02 00:53:31 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:32 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581.850fd8ac-72ab-4498-bf22-ff973fbf1830" returned: 0 in 0.439s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-850fd8ac-72ab-4498-bf22-ff973fbf1830" released by "_delete_snapshot" :: held 2.106s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-cf9d9b49-afcf-4711-8a46-3ac454420581" released by "delete_snapshot" :: held 2.133s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['32afd6bd-9c34-4ce6-b498-e6600f7aa91e', '49f10764-53bd-467c-8777-53334a5e8cb2', 'f1acc92d-6bbf-4fc3-96a9-1e85fbb08ad3', 'ecc9b5f9-7488-4de9-aee6-d8b7ec7ccb37'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Delete snapshot completed successfully. Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ef71067f-d9e1-4409-89b5-4390a0288630 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-850fd8ac-72ab-4498-bf22-ff973fbf1830-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-298f6ec4-1953-49e9-a59b-4dbea2b62a8a req-44aa14ae-f8a8-43ef-a007-d8c6d5acddb2 tempest-TestShelveInstance-83868739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-298f6ec4-1953-49e9-a59b-4dbea2b62a8a req-44aa14ae-f8a8-43ef-a007-d8c6d5acddb2 tempest-TestShelveInstance-83868739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-298f6ec4-1953-49e9-a59b-4dbea2b62a8a req-44aa14ae-f8a8-43ef-a007-d8c6d5acddb2 tempest-TestShelveInstance-83868739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-298f6ec4-1953-49e9-a59b-4dbea2b62a8a req-44aa14ae-f8a8-43ef-a007-d8c6d5acddb2 tempest-TestShelveInstance-83868739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14aa9fce-a789-4766-92e4-dcab7d2f9c41', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:53:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-298f6ec4-1953-49e9-a59b-4dbea2b62a8a req-44aa14ae-f8a8-43ef-a007-d8c6d5acddb2 tempest-TestShelveInstance-83868739 None] attachment_update completed successfully. Sep 02 00:53:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-cf9d9b49-afcf-4711-8a46-3ac454420581-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-cf9d9b49-afcf-4711-8a46-3ac454420581-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-cf9d9b49-afcf-4711-8a46-3ac454420581" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-cf9d9b49-afcf-4711-8a46-3ac454420581" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea165840-3658-487e-8cf6-52970546c14e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:33 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 Sep 02 00:53:33 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:34 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581" returned: 0 in 0.472s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:34 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581 Sep 02 00:53:34 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:34 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf9d9b49-afcf-4711-8a46-3ac454420581" returned: 0 in 0.320s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-cf9d9b49-afcf-4711-8a46-3ac454420581" released by "delete_volume" :: held 0.866s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['a9878752-0a3d-41de-9132-fe3bbd580db7', 'ee4b768d-dbc0-4b1c-936c-1bf0bb7bf17b', '9b2b02ce-1cde-4dfb-b3a0-82033385d818', 'f40d8558-4eec-44f8-a01f-63f94cdd4789'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:34 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:34 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-bd971b05-c5e5-461a-bc1f-d793dec4e28d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-bd971b05-c5e5-461a-bc1f-d793dec4e28d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "cinder-quobyte-bd971b05-c5e5-461a-bc1f-d793dec4e28d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:34 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Deleted volume successfully. Sep 02 00:53:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-bd971b05-c5e5-461a-bc1f-d793dec4e28d" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14e9902e-b955-4d46-9148-eaa7d71b4a53 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-cf9d9b49-afcf-4711-8a46-3ac454420581-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8520e19e-b12e-4980-9e93-b27dda6c5f5b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:35 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d Sep 02 00:53:35 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:35 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d" returned: 0 in 0.722s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:35 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d Sep 02 00:53:35 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:36 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bd971b05-c5e5-461a-bc1f-d793dec4e28d" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-quobyte-bd971b05-c5e5-461a-bc1f-d793dec4e28d" released by "delete_volume" :: held 1.289s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Created reservations ['6ce77e22-5ab4-4a58-b420-d2fcd52b1ba7', '4c8f689f-ce6d-453b-a658-fce13cdc1cc5', '8c37f658-d93b-4287-9a80-6834a5f864d4', 'c4b7e584-f877-4896-9201-a22063c7e783'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:36 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:36 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:36 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Deleted volume successfully. Sep 02 00:53:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d7146a9-a8cf-4586-ba8c-badca2ae8b13 tempest-VolumesSnapshotTestJSON-1181333694 None] Lock "cinder-bd971b05-c5e5-461a-bc1f-d793dec4e28d-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-45d3bbc4-e570-45a5-adcb-bfc9c9379337 req-cb4f6bf2-58da-4e62-8f41-578f7db14838 tempest-TestInstancesWithCinderVolumes-278512343 None] Terminate volume connection completed successfully. Sep 02 00:53:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-45d3bbc4-e570-45a5-adcb-bfc9c9379337 req-cb4f6bf2-58da-4e62-8f41-578f7db14838 tempest-TestInstancesWithCinderVolumes-278512343 None] Deleting attachment bb8e7728-261c-4dde-bbc0-082520d8ff4e. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:53:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "cinder-bee7bc92-5a38-4bd7-bff2-539398426a50-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-bee7bc92-5a38-4bd7-bff2-539398426a50-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "cinder-quobyte-bee7bc92-5a38-4bd7-bff2-539398426a50" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-quobyte-bee7bc92-5a38-4bd7-bff2-539398426a50" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c75500c-298d-4870-ac0c-92dd873f8423]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:38 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 Sep 02 00:53:38 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:38 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:38 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50 Sep 02 00:53:38 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:38 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-bee7bc92-5a38-4bd7-bff2-539398426a50" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-quobyte-bee7bc92-5a38-4bd7-bff2-539398426a50" released by "delete_volume" :: held 0.909s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:38 devstack cinder-volume[87232]: WARNING cinder.quota [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2014862869-899284370 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2014862869-899284370, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:53:38 devstack cinder-volume[87232]: WARNING cinder.quota [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2014862869-899284370 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2014862869-899284370, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Created reservations ['6e8563e4-505b-4c02-b105-8551730009e5', 'ad5b4c89-3746-4edc-be6c-98c4697a4595', '598c9fba-bb99-4640-a60b-32a79b4acc24', 'b160b3a6-3043-4e6c-91aa-7c1d90410d2b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:39 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:39 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:39 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.363s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:39 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Deleted volume successfully. Sep 02 00:53:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b146b88a-4d39-482f-9478-7e16278dbb76 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-bee7bc92-5a38-4bd7-bff2-539398426a50-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-f8556a81-a066-400a-8402-946b6eeb4ba0 req-221ded64-47b6-482f-aa09-206212d61bc9 tempest-TestInstancesWithCinderVolumes-278512343 None] Terminate volume connection completed successfully. Sep 02 00:53:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-f8556a81-a066-400a-8402-946b6eeb4ba0 req-221ded64-47b6-482f-aa09-206212d61bc9 tempest-TestInstancesWithCinderVolumes-278512343 None] Deleting attachment 61681b2e-d387-4ad8-835c-9301d04cf72f. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:53:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "cinder-54248113-693b-4cb0-92a9-cead266936b7-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-54248113-693b-4cb0-92a9-cead266936b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "cinder-quobyte-54248113-693b-4cb0-92a9-cead266936b7" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-quobyte-54248113-693b-4cb0-92a9-cead266936b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbd220f-9d76-4109-a369-262709bccdd4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:43 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 Sep 02 00:53:43 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:44 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7" returned: 0 in 0.515s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:44 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7 Sep 02 00:53:44 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:44 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-54248113-693b-4cb0-92a9-cead266936b7" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-quobyte-54248113-693b-4cb0-92a9-cead266936b7" released by "delete_volume" :: held 0.843s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:44 devstack cinder-volume[87232]: WARNING cinder.quota [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-929161220-2032567518 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-929161220-2032567518, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:53:44 devstack cinder-volume[87232]: WARNING cinder.quota [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-929161220-2032567518 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-929161220-2032567518, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Created reservations ['d6038b83-b3fc-4016-afcb-e6dfbcbc4a83', 'd791f955-8791-4461-97a6-620d827841c1', 'bba12303-7263-42d2-af72-bfca0c4bdfcd', '93b0b20f-5ad8-4c6a-bcfc-655176925534'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:44 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:44 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:45 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:45 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Deleted volume successfully. Sep 02 00:53:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2a3760bd-ba97-4ff9-9adc-b42bee4ecb27 tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-54248113-693b-4cb0-92a9-cead266936b7-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-ef7bd9d1-7a1c-433a-9c32-35de903c81f0 req-baf4474a-7f06-4be4-8a70-fb9398198f86 tempest-TestInstancesWithCinderVolumes-278512343 None] Terminate volume connection completed successfully. Sep 02 00:53:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-ef7bd9d1-7a1c-433a-9c32-35de903c81f0 req-baf4474a-7f06-4be4-8a70-fb9398198f86 tempest-TestInstancesWithCinderVolumes-278512343 None] Deleting attachment c25cfe0b-a65f-486d-9522-eccb1228273f. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "cinder-15943ddc-7f9e-4097-b1d8-c914d335a6d1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-15943ddc-7f9e-4097-b1d8-c914d335a6d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "cinder-quobyte-15943ddc-7f9e-4097-b1d8-c914d335a6d1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-quobyte-15943ddc-7f9e-4097-b1d8-c914d335a6d1" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cace10f1-2df7-42c6-b3b3-362702cbb536]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:50 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 Sep 02 00:53:50 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:50 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1" returned: 0 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:50 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1 Sep 02 00:53:50 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:51 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-15943ddc-7f9e-4097-b1d8-c914d335a6d1" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-quobyte-15943ddc-7f9e-4097-b1d8-c914d335a6d1" released by "delete_volume" :: held 0.792s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:53:51 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200519181-936770978 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200519181-936770978, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:53:51 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200519181-936770978 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-200519181-936770978, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Created reservations ['cfc2ef4d-6540-4ff3-905a-3729b48e1667', '3da4edca-bc4e-4a4b-b6c2-6fd6115fa7c9', '75915cac-b716-43ac-b7bb-7aca388c4e80', '3f9799ba-60ec-4768-968a-3755410aae18'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:53:51 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:53:51 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:53:51 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:53:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Deleted volume successfully. Sep 02 00:53:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b431ff0-de8e-43d0-9b03-d165a1dec6dd tempest-TestInstancesWithCinderVolumes-278512343 None] Lock "cinder-15943ddc-7f9e-4097-b1d8-c914d335a6d1-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:54:01 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=68,cinder:UPDATE=64,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:54:01 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:DELETE=5,cinder:SELECT=70,cinder:UPDATE=66,cinder:INSERT=23 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Flow 'volume_create_manager' (0100bf00-a102-4bcb-9141-a7ef7b4127de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267a4e4b-f18c-43df-b95e-1d02c8307dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267a4e4b-f18c-43df-b95e-1d02c8307dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-950717268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615db024c6984a7781ba430bc563018c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:54:10Z,use_quota=True,user_id='9abad9a76f0a47b8bbcd77bf031381d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4c0f9-7add-4b74-aec7-4a159e093ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4c0f9-7add-4b74-aec7-4a159e093ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1ee9fa-1655-42b7-8e33-94cbfd69e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1ee9fa-1655-42b7-8e33-94cbfd69e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa', 'volume_name': 'volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e699fa-416c-412b-b617-c1aea339f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e699fa-416c-412b-b617-c1aea339f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5c74e0-93de-49b5-aab4-c92f53634492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Volume aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa', 'volume_size': 1} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-950717268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615db024c6984a7781ba430bc563018c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:54:10Z,use_quota=True,user_id='9abad9a76f0a47b8bbcd77bf031381d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Creating volume aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:54:09 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:54:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:09 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa 1073741824 Sep 02 00:54:09 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:10 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa 1073741824" returned: 0 in 0.488s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:10 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa Sep 02 00:54:10 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:10 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5c74e0-93de-49b5-aab4-c92f53634492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644eac0f-8f0a-4bfe-a8ab-387b0f3267a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Volume volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa (aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa): created successfully Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644eac0f-8f0a-4bfe-a8ab-387b0f3267a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Flow 'volume_create_manager' (0100bf00-a102-4bcb-9141-a7ef7b4127de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:54:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ece09a23-6fee-4d69-b4ad-1b28d9316182 tempest-TestImageHashVerification-1467030603 None] Created volume successfully. Sep 02 00:54:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-bb2e9628-622d-4e4d-914b-62140c7f21da req-fa5df900-0ff7-46c0-9f28-e06f10c9e381 tempest-TestShelveInstance-83868739 None] Terminate volume connection completed successfully. Sep 02 00:54:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-bb2e9628-622d-4e4d-914b-62140c7f21da req-fa5df900-0ff7-46c0-9f28-e06f10c9e381 tempest-TestShelveInstance-83868739 None] Deleting attachment 14aa9fce-a789-4766-92e4-dcab7d2f9c41. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:12 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:54:12 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:12 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.363s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfecbd36-050d-4ebb-9ef3-331085e89c13]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:54:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:12 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa Sep 02 00:54:12 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:13 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec066bb2-6eef-4fe5-94f7-e49aeb8ff46f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:54:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:13 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa Sep 02 00:54:13 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:13 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa /opt/stack/data/cinder/conversion/aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa.temp_image.ae949be9-1946-426c-a18e-c1c63a1a9c3dpxogtuxf.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:13 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa /opt/stack/data/cinder/conversion/aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa.temp_image.ae949be9-1946-426c-a18e-c1c63a1a9c3dpxogtuxf.img Sep 02 00:54:13 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-6592d828-9d75-4d03-b3d4-dd25b4cf41a4 req-c2dce832-10a4-4462-a771-de7c1b6dd1be tempest-TestShelveInstance-83868739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:19 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa /opt/stack/data/cinder/conversion/aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa.temp_image.ae949be9-1946-426c-a18e-c1c63a1a9c3dpxogtuxf.img" returned: 0 in 5.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5008a55d-0a38-4e62-b813-aa5e6586e8ab]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:54:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:19 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa Sep 02 00:54:19 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:19 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" returned: 0 in 0.600s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:19 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/conversion/aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa.temp_image.ae949be9-1946-426c-a18e-c1c63a1a9c3dpxogtuxf.img {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:54:19 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Converted 1024.00 MB image at 190.63 MB/s Sep 02 00:54:19 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] ae949be9-1946-426c-a18e-c1c63a1a9c3d was raw, no need to convert to raw {{(pid=87232) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 02 00:54:24 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Flow 'volume_create_manager' (6b991a61-542a-4c0b-8a2f-0cea8934f23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abe09c7-f465-4b9c-bf43-37a7a286b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abe09c7-f465-4b9c-bf43-37a7a286b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1886784702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66693239-a2c0-471b-b852-ade3e97b0b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84b20f187d24c4f8be6c553f5627eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:54:37Z,use_quota=True,user_id='862b1f5a17bd438abf91ae472ad50e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5a30ea-94da-46a1-8547-868fdc3f65f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5a30ea-94da-46a1-8547-868fdc3f65f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af805de-dc09-43dc-a2a8-43ec976d9fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af805de-dc09-43dc-a2a8-43ec976d9fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66693239-a2c0-471b-b852-ade3e97b0b69', 'volume_name': 'volume-66693239-a2c0-471b-b852-ade3e97b0b69', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f77b3c-7bd0-4f38-9b34-c20119045c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f77b3c-7bd0-4f38-9b34-c20119045c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2cf5fc-19f9-4081-aa11-b58a4bbf30b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Volume 66693239-a2c0-471b-b852-ade3e97b0b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66693239-a2c0-471b-b852-ade3e97b0b69', 'volume_size': 1} Sep 02 00:54:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.654s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Uploaded volume to glance image-id: ae949be9-1946-426c-a18e-c1c63a1a9c3d. {{(pid=87232) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-6592d828-9d75-4d03-b3d4-dd25b4cf41a4 req-c2dce832-10a4-4462-a771-de7c1b6dd1be tempest-TestShelveInstance-83868739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 28.382s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-6592d828-9d75-4d03-b3d4-dd25b4cf41a4 req-c2dce832-10a4-4462-a771-de7c1b6dd1be tempest-TestShelveInstance-83868739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.546s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1886784702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66693239-a2c0-471b-b852-ade3e97b0b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84b20f187d24c4f8be6c553f5627eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:54:37Z,use_quota=True,user_id='862b1f5a17bd438abf91ae472ad50e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Creating volume 66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:54:42 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-efe8fa00-057a-4511-8269-29b2e34f5ab3 tempest-TestImageHashVerification-1467030603 None] Copy volume to image completed successfully. Sep 02 00:54:42 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 1073741824 Sep 02 00:54:42 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-6592d828-9d75-4d03-b3d4-dd25b4cf41a4 req-c2dce832-10a4-4462-a771-de7c1b6dd1be tempest-TestShelveInstance-83868739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05f8ec4a-e6b8-4b30-8555-c379527fca2a', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:54:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-6592d828-9d75-4d03-b3d4-dd25b4cf41a4 req-c2dce832-10a4-4462-a771-de7c1b6dd1be tempest-TestShelveInstance-83868739 None] attachment_update completed successfully. Sep 02 00:54:43 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 1073741824" returned: 0 in 0.873s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:43 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 Sep 02 00:54:43 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:43 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2cf5fc-19f9-4081-aa11-b58a4bbf30b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66693239-a2c0-471b-b852-ade3e97b0b69', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e9b88-a6ea-4f2e-bd01-9dbe93f79e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:54:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Volume volume-66693239-a2c0-471b-b852-ade3e97b0b69 (66693239-a2c0-471b-b852-ade3e97b0b69): created successfully Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e9b88-a6ea-4f2e-bd01-9dbe93f79e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:54:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Flow 'volume_create_manager' (6b991a61-542a-4c0b-8a2f-0cea8934f23a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:54:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9240a984-db3a-4d2b-a4b1-7051a35c0560 tempest-TestStampPattern-1388898446 None] Created volume successfully. Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Acquiring lock "cinder-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Lock "cinder-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Acquiring lock "cinder-quobyte-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Lock "cinder-quobyte-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2255f5f2-f977-48f1-9c9f-90e1db277ce4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:44 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa Sep 02 00:54:44 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:44 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" returned: 0 in 0.443s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:44 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa Sep 02 00:54:44 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:45 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Lock "cinder-quobyte-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa" released by "delete_volume" :: held 0.824s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Created reservations ['8caf8bf7-48b5-49ed-a9ea-1e96cb330cc5', '1816d86b-b3f0-4a35-b5c2-e06291534b32', 'c933e5dd-4841-4685-b807-2fefee2e53be', '7df85c85-f017-4a28-b028-8d695aaae3de'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:54:45 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:54:45 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:54:45 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:54:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Deleted volume successfully. Sep 02 00:54:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cd179e07-7eb5-40bc-92fc-39b95a9c7e9c tempest-TestImageHashVerification-1467030603 None] Lock "cinder-aeb273bc-90ea-4ab9-b0f6-f6e11055ddaa-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:54:55 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:54:55 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Flow 'volume_create_manager' (4e8cded4-c7a6-45a6-8b63-f63ec080745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a3c01e-7544-4928-a0ef-2ac2a37c0c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56a3c01e-7544-4928-a0ef-2ac2a37c0c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bdde33-ea2f-4295-825c-be3cc53ddf93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cbefbfacff4f56a8d3ae8fd92c4fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:04Z,use_quota=True,user_id='850b46f111ce4bbe90e1635aebf08a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61e5b7a7-ecb0-4bf0-bf5c-e7f56f159dc8),volume_type_id=61e5b7a7-ecb0-4bf0-bf5c-e7f56f159dc8)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da022015-66ee-4e08-ae43-0407ec3e9755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da022015-66ee-4e08-ae43-0407ec3e9755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7cdcbe-329d-4c98-98ac-cbabdf5ad342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7cdcbe-329d-4c98-98ac-cbabdf5ad342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63bdde33-ea2f-4295-825c-be3cc53ddf93', 'volume_name': 'volume-63bdde33-ea2f-4295-825c-be3cc53ddf93', 'volume_size': 1, 'image_id': '5b669f1a-1e89-4182-8b92-630b9bddd705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b669f1a-1e89-4182-8b92-630b9bddd705', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '64dd3bd056d51524dffda3374a712fd3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17cbefbfacff4f56a8d3ae8fd92c4fe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a06d1fc08830104ccd561fbec00dcd2167c24e76048e80151267adfc78c022880cb57cd6ef789f42d6d0ce9fe49062e5fef13c96c3523e9d2838e35b3c29331', 'id': '5b669f1a-1e89-4182-8b92-630b9bddd705', 'created_at': datetime.datetime(2026, 9, 1, 22, 55, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 55, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b669f1a-1e89-4182-8b92-630b9bddd705/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac5db7-91aa-4141-aa71-353a5215a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ac5db7-91aa-4141-aa71-353a5215a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de28942-f5cf-4be8-862e-c03fa93bccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Volume 63bdde33-ea2f-4295-825c-be3cc53ddf93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63bdde33-ea2f-4295-825c-be3cc53ddf93', 'volume_size': 1, 'image_id': '5b669f1a-1e89-4182-8b92-630b9bddd705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b669f1a-1e89-4182-8b92-630b9bddd705', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '64dd3bd056d51524dffda3374a712fd3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17cbefbfacff4f56a8d3ae8fd92c4fe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a06d1fc08830104ccd561fbec00dcd2167c24e76048e80151267adfc78c022880cb57cd6ef789f42d6d0ce9fe49062e5fef13c96c3523e9d2838e35b3c29331', 'id': '5b669f1a-1e89-4182-8b92-630b9bddd705', 'created_at': datetime.datetime(2026, 9, 1, 22, 55, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 55, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b669f1a-1e89-4182-8b92-630b9bddd705/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Trying to clone 63bdde33-ea2f-4295-825c-be3cc53ddf93 from image 5b669f1a-1e89-4182-8b92-630b9bddd705 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5b669f1a-1e89-4182-8b92-630b9bddd705', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:55:04 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff28f4-54e4-4b48-b70b-9e96a8434ed2]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:04 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD Sep 02 00:55:04 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:05 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:05 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD Sep 02 00:55:05 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:05 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Temporary image 5b669f1a-1e89-4182-8b92-630b9bddd705 is fetched for user 850b46f111ce4bbe90e1635aebf08a66. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed1790-9d16-45a2-a32e-4185c94fe70d]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:05 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD Sep 02 00:55:05 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:05 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:05 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD Sep 02 00:55:05 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:06 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bdde33-ea2f-4295-825c-be3cc53ddf93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17cbefbfacff4f56a8d3ae8fd92c4fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:04Z,use_quota=True,user_id='850b46f111ce4bbe90e1635aebf08a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61e5b7a7-ecb0-4bf0-bf5c-e7f56f159dc8),volume_type_id=61e5b7a7-ecb0-4bf0-bf5c-e7f56f159dc8)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Creating volume 63bdde33-ea2f-4295-825c-be3cc53ddf93 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:06 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:06 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 1073741824 Sep 02 00:55:06 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:06 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 1073741824" returned: 0 in 0.410s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:06 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 Sep 02 00:55:06 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:06 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Attempting download of 5b669f1a-1e89-4182-8b92-630b9bddd705 ((None, [{'url': 'file:///opt/stack/data/glance/images/5b669f1a-1e89-4182-8b92-630b9bddd705', 'metadata': {}}])) to volume 63bdde33-ea2f-4295-825c-be3cc53ddf93. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80c7398-28c4-4b6a-8da9-3223c27c113f]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b669f1a-1e89-4182-8b92-630b9bddd705_ajwavlco {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:07 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b669f1a-1e89-4182-8b92-630b9bddd705_ajwavlco Sep 02 00:55:07 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:07 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5b669f1a-1e89-4182-8b92-630b9bddd705_ajwavlco" returned: 0 in 0.343s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b669f1a-1e89-4182-8b92-630b9bddd705_ajwavlco {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:07 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b669f1a-1e89-4182-8b92-630b9bddd705_ajwavlco Sep 02 00:55:07 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:07 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b669f1a-1e89-4182-8b92-630b9bddd705_ajwavlco" returned: 1 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5b669f1a-1e89-4182-8b92-630b9bddd705_ajwavlco' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ba288-863f-4b90-84f1-ddb6759c7059]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:07 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD Sep 02 00:55:07 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:07 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:08 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD Sep 02 00:55:08 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:08 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:55:08 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] 5b669f1a-1e89-4182-8b92-630b9bddd705 was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:55:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:08 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 Sep 02 00:55:08 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:08 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93" returned: 0 in 0.412s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:08 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5b669f1a-1e89-4182-8b92-630b9bddd705_m87sjmxgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:55:08 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:55:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:08 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 1G Sep 02 00:55:08 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:09 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 1G" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Downloaded image 5b669f1a-1e89-4182-8b92-630b9bddd705 ((None, [{'url': 'file:///opt/stack/data/glance/images/5b669f1a-1e89-4182-8b92-630b9bddd705', 'metadata': {}}])) to volume 63bdde33-ea2f-4295-825c-be3cc53ddf93 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Temporary image 5b669f1a-1e89-4182-8b92-630b9bddd705 for user 850b46f111ce4bbe90e1635aebf08a66 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Marking volume 63bdde33-ea2f-4295-825c-be3cc53ddf93 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Copying metadata from image 5b669f1a-1e89-4182-8b92-630b9bddd705 to 63bdde33-ea2f-4295-825c-be3cc53ddf93. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Creating volume glance metadata for volume 63bdde33-ea2f-4295-825c-be3cc53ddf93 backed by image 5b669f1a-1e89-4182-8b92-630b9bddd705 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5b669f1a-1e89-4182-8b92-630b9bddd705', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '64dd3bd056d51524dffda3374a712fd3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de28942-f5cf-4be8-862e-c03fa93bccf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bdde33-ea2f-4295-825c-be3cc53ddf93', 'volume_size': 1, 'image_id': '5b669f1a-1e89-4182-8b92-630b9bddd705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5b669f1a-1e89-4182-8b92-630b9bddd705', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '64dd3bd056d51524dffda3374a712fd3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17cbefbfacff4f56a8d3ae8fd92c4fe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a06d1fc08830104ccd561fbec00dcd2167c24e76048e80151267adfc78c022880cb57cd6ef789f42d6d0ce9fe49062e5fef13c96c3523e9d2838e35b3c29331', 'id': '5b669f1a-1e89-4182-8b92-630b9bddd705', 'created_at': datetime.datetime(2026, 9, 1, 22, 55, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 55, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5b669f1a-1e89-4182-8b92-630b9bddd705/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5701d7a9-559f-4297-ad9e-1b27cc1a1ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Volume volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 (63bdde33-ea2f-4295-825c-be3cc53ddf93): created successfully Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5701d7a9-559f-4297-ad9e-1b27cc1a1ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Flow 'volume_create_manager' (4e8cded4-c7a6-45a6-8b63-f63ec080745c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a5cdb8bd-ddb0-47e0-8d7a-312d8445388a tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Created volume successfully. Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Acquiring lock "cinder-63bdde33-ea2f-4295-825c-be3cc53ddf93-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "cinder-63bdde33-ea2f-4295-825c-be3cc53ddf93-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Acquiring lock "cinder-quobyte-63bdde33-ea2f-4295-825c-be3cc53ddf93" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "cinder-quobyte-63bdde33-ea2f-4295-825c-be3cc53ddf93" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde50c4-ea3e-48d0-8eac-95406977cc46]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:09 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 Sep 02 00:55:09 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:09 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:09 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93 Sep 02 00:55:09 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:10 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-63bdde33-ea2f-4295-825c-be3cc53ddf93" returned: 0 in 0.236s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "cinder-quobyte-63bdde33-ea2f-4295-825c-be3cc53ddf93" released by "delete_volume" :: held 0.629s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:10 devstack cinder-volume[87232]: WARNING cinder.quota [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:55:10 devstack cinder-volume[87232]: WARNING cinder.quota [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Created reservations ['6f8e043c-fa33-4c79-b08e-777933feda7d', '095fa335-ca27-4743-9ba6-d98c5e654dcf', 'ff928ddc-26d7-4b77-8527-e75267dca69e', 'fb6ad000-20f6-4228-ae5d-72ce245bd386'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:10 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:10 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:10 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Deleted volume successfully. Sep 02 00:55:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-250a5240-2e94-4c3b-9574-2de36d93e51e tempest-VolumeAndVolumeTypeFromImageTest-383298851 None] Lock "cinder-63bdde33-ea2f-4295-825c-be3cc53ddf93-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:12 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:12 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-dc45e9cf-752e-413f-9367-a38ddcd4ce1c req-ce0b494e-f9da-4834-b52c-7dc5ff54ff21 tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-dc45e9cf-752e-413f-9367-a38ddcd4ce1c req-ce0b494e-f9da-4834-b52c-7dc5ff54ff21 tempest-TestStampPattern-1388898446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-dc45e9cf-752e-413f-9367-a38ddcd4ce1c req-ce0b494e-f9da-4834-b52c-7dc5ff54ff21 tempest-TestStampPattern-1388898446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-dc45e9cf-752e-413f-9367-a38ddcd4ce1c req-ce0b494e-f9da-4834-b52c-7dc5ff54ff21 tempest-TestStampPattern-1388898446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-66693239-a2c0-471b-b852-ade3e97b0b69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '747e4c53-d54a-4ad0-9054-d42302c54513', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:55:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-dc45e9cf-752e-413f-9367-a38ddcd4ce1c req-ce0b494e-f9da-4834-b52c-7dc5ff54ff21 tempest-TestStampPattern-1388898446 None] attachment_update completed successfully. Sep 02 00:55:12 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:55:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:55:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-94a4c99d-4986-4360-b1c2-d7301734232b req-7de47793-f457-459f-9c79-8443860597cc tempest-TestShelveInstance-83868739 None] Terminate volume connection completed successfully. Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-94a4c99d-4986-4360-b1c2-d7301734232b req-7de47793-f457-459f-9c79-8443860597cc tempest-TestShelveInstance-83868739 None] Deleting attachment 05f8ec4a-e6b8-4b30-8555-c379527fca2a. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:55:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-65eb8c11-8596-47ce-8e80-d4558803a1e8 req-3274d402-56af-4416-aa0b-d3313465c99f tempest-TestStampPattern-1388898446 None] Terminate volume connection completed successfully. Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-65eb8c11-8596-47ce-8e80-d4558803a1e8 req-3274d402-56af-4416-aa0b-d3313465c99f tempest-TestStampPattern-1388898446 None] Deleting attachment 747e4c53-d54a-4ad0-9054-d42302c54513. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Acquiring lock "cinder-4ccf404e-a1e9-4520-b49e-78f8f0f0d426-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Lock "cinder-4ccf404e-a1e9-4520-b49e-78f8f0f0d426-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Acquiring lock "cinder-quobyte-4ccf404e-a1e9-4520-b49e-78f8f0f0d426" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Lock "cinder-quobyte-4ccf404e-a1e9-4520-b49e-78f8f0f0d426" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b769d6a5-c7ac-4dde-84c7-3c3a64d057b0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:18 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 Sep 02 00:55:18 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:19 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:19 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426 Sep 02 00:55:19 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:19 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4ccf404e-a1e9-4520-b49e-78f8f0f0d426" returned: 0 in 0.348s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Lock "cinder-quobyte-4ccf404e-a1e9-4520-b49e-78f8f0f0d426" released by "delete_volume" :: held 0.837s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG cinder.quota [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Created reservations ['35af1f0b-c7c6-45df-8459-6cfde6c7d1c2', 'dc295696-9890-4ee2-91f3-228e4b3184a2', '89d19992-8bab-4c50-a77f-879d943516aa', '89d796d2-0be4-4989-9cb2-6a1ffd878006'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Creating offline snapshot 67d40a7c-93c9-4b5f-9991-7ac958d2abac of volume 66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:55:19 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:19 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d4b177-7439-405b-88d6-7e7d16a19132]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:20 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 Sep 02 00:55:20 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:20 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:20 devstack cinder-volume[87232]: DEBUG cinder.manager [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Deleted volume successfully. Sep 02 00:55:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-94a4c99d-4986-4360-b1c2-d7301734232b req-a743b877-0925-4c96-8038-89f48592e855 tempest-TestShelveInstance-83868739 None] Lock "cinder-4ccf404e-a1e9-4520-b49e-78f8f0f0d426-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:20 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69" returned: 0 in 0.492s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:20 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac 1G Sep 02 00:55:20 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:20 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac 1G" returned: 0 in 0.462s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66693239-a2c0-471b-b852-ade3e97b0b69 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:20 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66693239-a2c0-471b-b852-ade3e97b0b69 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac Sep 02 00:55:20 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:21 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66693239-a2c0-471b-b852-ade3e97b0b69 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:21 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac is being set with open permissions: ugo+rw Sep 02 00:55:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:21 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac Sep 02 00:55:21 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:21 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:21 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.info Sep 02 00:55:21 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:21 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.info" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:21 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.info is being set with open permissions: ugo+rw Sep 02 00:55:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:21 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.info Sep 02 00:55:21 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:22 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.info" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c3ce3476-347b-49a8-9992-faeb4e5f7aea tempest-TestStampPattern-1388898446 None] Create snapshot completed successfully Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Flow 'volume_create_manager' (04cd101d-556e-46b5-9d16-4bc3a9ac15a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745cb9a1-eb50-4fee-ac1b-4ca5728fa253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745cb9a1-eb50-4fee-ac1b-4ca5728fa253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2137650398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ef1f6f-1d39-42fb-b49f-72350a427bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84b20f187d24c4f8be6c553f5627eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67d40a7c-93c9-4b5f-9991-7ac958d2abac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:30Z,use_quota=True,user_id='862b1f5a17bd438abf91ae472ad50e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beac7296-f507-4f86-95b0-8427f723974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beac7296-f507-4f86-95b0-8427f723974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafa681f-2f83-49b4-aecf-f1ad9cf25f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafa681f-2f83-49b4-aecf-f1ad9cf25f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20ef1f6f-1d39-42fb-b49f-72350a427bab', 'volume_name': 'volume-20ef1f6f-1d39-42fb-b49f-72350a427bab', 'volume_size': 1, 'snapshot_id': '67d40a7c-93c9-4b5f-9991-7ac958d2abac'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c762b5b-3afd-4ee7-9794-ee1fefa6fe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c762b5b-3afd-4ee7-9794-ee1fefa6fe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82785497-7738-46bb-b334-5592484458ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Volume 20ef1f6f-1d39-42fb-b49f-72350a427bab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20ef1f6f-1d39-42fb-b49f-72350a427bab', 'volume_size': 1, 'snapshot_id': '67d40a7c-93c9-4b5f-9991-7ac958d2abac'} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-quobyte-67d40a7c-93c9-4b5f-9991-7ac958d2abac-20ef1f6f-1d39-42fb-b49f-72350a427bab" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-67d40a7c-93c9-4b5f-9991-7ac958d2abac-20ef1f6f-1d39-42fb-b49f-72350a427bab" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Creating volume 20ef1f6f-1d39-42fb-b49f-72350a427bab from snapshot 67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-quobyte-20ef1f6f-1d39-42fb-b49f-72350a427bab" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-20ef1f6f-1d39-42fb-b49f-72350a427bab" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] snapshot: 67d40a7c-93c9-4b5f-9991-7ac958d2abac, volume: 20ef1f6f-1d39-42fb-b49f-72350a427bab, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9cce17-0585-438e-9eb8-347b217e151a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:30 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac Sep 02 00:55:30 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:30 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac" returned: 0 in 0.473s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66693239-a2c0-471b-b852-ade3e97b0b69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9044a0-ebf4-4432-9ec9-d55d2852ceb0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:30 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 Sep 02 00:55:30 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:30 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:55:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:55:31 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:55:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:31 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab Sep 02 00:55:31 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:37 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab" returned: 0 in 6.567s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:37 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:55:37 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Converted 1024.00 MB image at 155.89 MB/s Sep 02 00:55:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab is being set with open permissions: ugo+rw Sep 02 00:55:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:37 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab Sep 02 00:55:37 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:37 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-20ef1f6f-1d39-42fb-b49f-72350a427bab" released by "_copy_volume_from_snapshot" :: held 7.936s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-67d40a7c-93c9-4b5f-9991-7ac958d2abac-20ef1f6f-1d39-42fb-b49f-72350a427bab" released by "_create_volume_from_snapshot" :: held 8.013s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.031s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82785497-7738-46bb-b334-5592484458ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ef1f6f-1d39-42fb-b49f-72350a427bab', 'volume_size': 1, 'snapshot_id': '67d40a7c-93c9-4b5f-9991-7ac958d2abac'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c300e139-e7c6-478d-bd36-aa32a6adc56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Volume volume-20ef1f6f-1d39-42fb-b49f-72350a427bab (20ef1f6f-1d39-42fb-b49f-72350a427bab): created successfully Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c300e139-e7c6-478d-bd36-aa32a6adc56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Flow 'volume_create_manager' (04cd101d-556e-46b5-9d16-4bc3a9ac15a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-daac728e-418c-41a8-b92c-a9a1108fe43d tempest-TestStampPattern-1388898446 None] Created volume successfully. Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (ff50de5a-ce4d-4793-8c80-0af7ef3abf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67218a0-105a-4210-a515-82b29a56f9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67218a0-105a-4210-a515-82b29a56f9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1832433511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af674a1a-bc86-4dc8-95df-d7537e038421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:39Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ade3842-4806-4c65-a351-b5befad3016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ade3842-4806-4c65-a351-b5befad3016f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7c4baf-47c6-4aee-a736-b3f2034d12a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7c4baf-47c6-4aee-a736-b3f2034d12a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af674a1a-bc86-4dc8-95df-d7537e038421', 'volume_name': 'volume-af674a1a-bc86-4dc8-95df-d7537e038421', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c9f6a6-3078-4d12-a4f8-e9afcf1688a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c9f6a6-3078-4d12-a4f8-e9afcf1688a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bca838-76e4-4cf8-81a9-960170350e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume af674a1a-bc86-4dc8-95df-d7537e038421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af674a1a-bc86-4dc8-95df-d7537e038421', 'volume_size': 1} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1832433511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af674a1a-bc86-4dc8-95df-d7537e038421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:39Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Creating volume af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:38 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:55:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:38 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 1073741824 Sep 02 00:55:38 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:39 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 1073741824" returned: 0 in 0.665s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:39 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 Sep 02 00:55:39 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:39 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bca838-76e4-4cf8-81a9-960170350e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af674a1a-bc86-4dc8-95df-d7537e038421', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750ba17e-2211-40b6-be2b-5527a3463c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume volume-af674a1a-bc86-4dc8-95df-d7537e038421 (af674a1a-bc86-4dc8-95df-d7537e038421): created successfully Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750ba17e-2211-40b6-be2b-5527a3463c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (ff50de5a-ce4d-4793-8c80-0af7ef3abf27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f1edfdd2-46cc-4aeb-b65b-1a7a54be8195 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created volume successfully. Sep 02 00:55:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Creating offline snapshot c3e6e336-ad5a-4047-aa34-591904ca41ae of volume af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:55:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e33c30c-ca55-4b99-b4f3-1d3a2d089d8d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:41 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 Sep 02 00:55:41 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:41 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:41 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae 1G Sep 02 00:55:41 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:42 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae 1G" returned: 0 in 0.443s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af674a1a-bc86-4dc8-95df-d7537e038421 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:42 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af674a1a-bc86-4dc8-95df-d7537e038421 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae Sep 02 00:55:42 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:42 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af674a1a-bc86-4dc8-95df-d7537e038421 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae" returned: 0 in 0.312s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:42 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae is being set with open permissions: ugo+rw Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:42 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae Sep 02 00:55:42 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:42 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae" returned: 0 in 0.268s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:42 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.info Sep 02 00:55:42 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:42 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.info" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:42 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.info is being set with open permissions: ugo+rw Sep 02 00:55:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:43 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.info Sep 02 00:55:43 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:43 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.info" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6b72caae-1a5e-4ecc-8221-93359cc31269 tempest-CreateVolumesFromSnapshotTest-958170011 None] Create snapshot completed successfully Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (173b9999-3724-4445-bdcf-b339617e3a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be27025-9042-4ce6-9be9-e4b9bc85a9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be27025-9042-4ce6-9be9-e4b9bc85a9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084400442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647752a8-060c-47f7-ae0b-aa385b78c1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:45Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8e8b62-58d8-4785-8a4f-c2efac35d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8e8b62-58d8-4785-8a4f-c2efac35d473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ef557d-f4cd-4753-841d-c4b94520a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ef557d-f4cd-4753-841d-c4b94520a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647752a8-060c-47f7-ae0b-aa385b78c1ee', 'volume_name': 'volume-647752a8-060c-47f7-ae0b-aa385b78c1ee', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a36fcfb-913d-4bcc-8231-ee7964350387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a36fcfb-913d-4bcc-8231-ee7964350387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cf8e0-6bd4-46ee-bcd7-d09382d05ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume 647752a8-060c-47f7-ae0b-aa385b78c1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647752a8-060c-47f7-ae0b-aa385b78c1ee', 'volume_size': 1} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084400442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647752a8-060c-47f7-ae0b-aa385b78c1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:45Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Creating volume 647752a8-060c-47f7-ae0b-aa385b78c1ee {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:44 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:55:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:44 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee 1073741824 Sep 02 00:55:44 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (3fbc61a9-1d4d-4cea-9c86-59733742d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c74f915-d48b-4f47-a4ef-c8a89d833407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c74f915-d48b-4f47-a4ef-c8a89d833407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-945959195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62c787e-751d-476c-b73a-bd75654a392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:45Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c4cdc-bfbf-4ad7-a06c-acde9e3d7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c4cdc-bfbf-4ad7-a06c-acde9e3d7d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e1ca00-054c-48d0-96d6-3d88ea5cda85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e1ca00-054c-48d0-96d6-3d88ea5cda85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62c787e-751d-476c-b73a-bd75654a392b', 'volume_name': 'volume-c62c787e-751d-476c-b73a-bd75654a392b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9c3ee5-ea86-46e4-bccd-0aae32a179ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9c3ee5-ea86-46e4-bccd-0aae32a179ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce104f28-3127-4877-9f81-eadc3c4746f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume c62c787e-751d-476c-b73a-bd75654a392b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62c787e-751d-476c-b73a-bd75654a392b', 'volume_size': 1} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:45 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee 1073741824" returned: 0 in 0.564s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:45 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee Sep 02 00:55:45 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (229c786d-bb09-4bf8-bbe0-d16189f62d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da30c323-38b7-4644-8275-b3a803211d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da30c323-38b7-4644-8275-b3a803211d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1688069878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5c35f6-bb24-4a7f-a94a-7e76695cfbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:46Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e33ece-62d2-4ff1-b9ff-0c40d5840b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e33ece-62d2-4ff1-b9ff-0c40d5840b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63814e3e-08ef-459d-89a0-68e3b53247f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63814e3e-08ef-459d-89a0-68e3b53247f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5c35f6-bb24-4a7f-a94a-7e76695cfbda', 'volume_name': 'volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d591d9-6658-4ad1-ad44-7ac14544d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d591d9-6658-4ad1-ad44-7ac14544d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a4ccc9-fddf-44d0-ba63-bc361564a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume fa5c35f6-bb24-4a7f-a94a-7e76695cfbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda', 'volume_size': 1} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:45 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-945959195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62c787e-751d-476c-b73a-bd75654a392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:45Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Creating volume c62c787e-751d-476c-b73a-bd75654a392b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:45 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cf8e0-6bd4-46ee-bcd7-d09382d05ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647752a8-060c-47f7-ae0b-aa385b78c1ee', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b 1073741824 Sep 02 00:55:45 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b96868-0593-4c41-94ff-5b9b93a48f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume volume-647752a8-060c-47f7-ae0b-aa385b78c1ee (647752a8-060c-47f7-ae0b-aa385b78c1ee): created successfully Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b96868-0593-4c41-94ff-5b9b93a48f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (173b9999-3724-4445-bdcf-b339617e3a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fa8affdb-514c-42dd-a64a-55b46d0e9cda tempest-CreateVolumesFromSnapshotTest-958170011 None] Created volume successfully. Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (cf18d23d-00fc-4916-88bd-275225df5009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1497ba37-796c-4fed-8778-617d20b899b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1497ba37-796c-4fed-8778-617d20b899b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847833114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03e253f-0cda-4fab-8787-a82def8e1ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:46Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98686f1e-b653-4c39-a694-6a930c74f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98686f1e-b653-4c39-a694-6a930c74f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e07ae9-643d-4b9d-af3e-8d5be8ca645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e07ae9-643d-4b9d-af3e-8d5be8ca645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03e253f-0cda-4fab-8787-a82def8e1ab6', 'volume_name': 'volume-b03e253f-0cda-4fab-8787-a82def8e1ab6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aef9bf8-002b-4b65-8fa2-27e41d5efb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aef9bf8-002b-4b65-8fa2-27e41d5efb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6e7700-e929-460f-a50d-134c8056ead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume b03e253f-0cda-4fab-8787-a82def8e1ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03e253f-0cda-4fab-8787-a82def8e1ab6', 'volume_size': 1} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:46 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b 1073741824" returned: 0 in 0.634s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:46 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b Sep 02 00:55:46 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (605ff715-7ba9-47cb-b5bf-0449853ec4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24575b4-475c-400d-a5cc-4605ab3475da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24575b4-475c-400d-a5cc-4605ab3475da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012053468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191ee4a4-9545-4bdd-b15a-cecc40f07bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:47Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf082545-6c44-471c-8c49-030c1c8971b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf082545-6c44-471c-8c49-030c1c8971b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b512b-ba09-4f4b-8274-153a7be2c6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b512b-ba09-4f4b-8274-153a7be2c6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191ee4a4-9545-4bdd-b15a-cecc40f07bc8', 'volume_name': 'volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1815e421-71d2-47d6-b3cb-f526c5e9026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1815e421-71d2-47d6-b3cb-f526c5e9026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36f0179-5e8d-40dc-8dad-0718f97420a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume 191ee4a4-9545-4bdd-b15a-cecc40f07bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8', 'volume_size': 1} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:46 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1688069878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5c35f6-bb24-4a7f-a94a-7e76695cfbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:46Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Creating volume fa5c35f6-bb24-4a7f-a94a-7e76695cfbda {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:46 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce104f28-3127-4877-9f81-eadc3c4746f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62c787e-751d-476c-b73a-bd75654a392b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda 1073741824 Sep 02 00:55:46 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5342d9-f52e-4608-ad1d-80e31fb157e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume volume-c62c787e-751d-476c-b73a-bd75654a392b (c62c787e-751d-476c-b73a-bd75654a392b): created successfully Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5342d9-f52e-4608-ad1d-80e31fb157e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (3fbc61a9-1d4d-4cea-9c86-59733742d73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9bd685ac-c2b1-4178-a364-07c5f0c2cdc1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created volume successfully. Sep 02 00:55:47 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda 1073741824" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:47 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda Sep 02 00:55:47 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:47 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847833114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03e253f-0cda-4fab-8787-a82def8e1ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:46Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Creating volume b03e253f-0cda-4fab-8787-a82def8e1ab6 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:47 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 1073741824 Sep 02 00:55:47 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a4ccc9-fddf-44d0-ba63-bc361564a581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7813483d-ff04-446b-b8b1-effe3f7f696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda (fa5c35f6-bb24-4a7f-a94a-7e76695cfbda): created successfully Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7813483d-ff04-446b-b8b1-effe3f7f696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (229c786d-bb09-4bf8-bbe0-d16189f62d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cf0596b1-d49f-459f-9464-3f48d38f4f6c tempest-CreateVolumesFromSnapshotTest-958170011 None] Created volume successfully. Sep 02 00:55:47 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 1073741824" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:48 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 Sep 02 00:55:48 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:48 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012053468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191ee4a4-9545-4bdd-b15a-cecc40f07bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d969bca3254462189e4e1de8176a1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:55:47Z,use_quota=True,user_id='41eb079cf97b4d5eafd5a015819653eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Creating volume 191ee4a4-9545-4bdd-b15a-cecc40f07bc8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:55:48 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6e7700-e929-460f-a50d-134c8056ead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03e253f-0cda-4fab-8787-a82def8e1ab6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:48 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 1073741824 Sep 02 00:55:48 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb7f11d-5f5c-4f26-9ae7-f527318efe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 (b03e253f-0cda-4fab-8787-a82def8e1ab6): created successfully Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb7f11d-5f5c-4f26-9ae7-f527318efe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (cf18d23d-00fc-4916-88bd-275225df5009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-22a033ef-5d1d-40af-9cc0-cfb1f2656ee9 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created volume successfully. Sep 02 00:55:48 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 1073741824" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:48 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 Sep 02 00:55:48 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:49 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8" returned: 0 in 0.290s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:55:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36f0179-5e8d-40dc-8dad-0718f97420a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee56936-8d14-4fca-95e8-b2fdeda0b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:55:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Volume volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 (191ee4a4-9545-4bdd-b15a-cecc40f07bc8): created successfully Sep 02 00:55:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee56936-8d14-4fca-95e8-b2fdeda0b78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:55:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Flow 'volume_create_manager' (605ff715-7ba9-47cb-b5bf-0449853ec4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:55:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-85222f79-41be-4b48-911f-f750965ece7e tempest-CreateVolumesFromSnapshotTest-958170011 None] Created volume successfully. Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-191ee4a4-9545-4bdd-b15a-cecc40f07bc8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-191ee4a4-9545-4bdd-b15a-cecc40f07bc8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-191ee4a4-9545-4bdd-b15a-cecc40f07bc8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-191ee4a4-9545-4bdd-b15a-cecc40f07bc8" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916e09a-0ad7-49f5-8896-b041931dfb78]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:50 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 Sep 02 00:55:50 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:50 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:50 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8 Sep 02 00:55:50 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:50 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-191ee4a4-9545-4bdd-b15a-cecc40f07bc8" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-191ee4a4-9545-4bdd-b15a-cecc40f07bc8" released by "delete_volume" :: held 0.661s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Created reservations ['034c63f0-218f-46fd-a82f-1fa68d2e9eee', '4f7714a1-1406-4bba-b815-6dee4bdbaabb', '0cb065b7-0b2e-4b5a-a5d8-31cd064c662e', '887ae1d8-a006-464a-b8e5-11fecf52d93b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:50 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:50 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:51 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Deleted volume successfully. Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47fccba3-61da-4977-b7ad-bbc793f3c07f tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-191ee4a4-9545-4bdd-b15a-cecc40f07bc8-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-b03e253f-0cda-4fab-8787-a82def8e1ab6-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-b03e253f-0cda-4fab-8787-a82def8e1ab6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-b03e253f-0cda-4fab-8787-a82def8e1ab6" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-b03e253f-0cda-4fab-8787-a82def8e1ab6" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed9790-84c8-4e00-9eeb-3bf0e313fe3b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:51 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 Sep 02 00:55:51 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:51 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6" returned: 0 in 0.384s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:51 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6 Sep 02 00:55:51 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:51 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b03e253f-0cda-4fab-8787-a82def8e1ab6" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-b03e253f-0cda-4fab-8787-a82def8e1ab6" released by "delete_volume" :: held 0.668s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created reservations ['cb0f503d-dccb-445e-962c-8f4f858e501a', 'e9817356-75c5-48e1-adcf-4abed36c16f7', 'e3911d28-0dd4-4b73-80c7-2440f42a4bad', '34cbdae9-7de4-427a-9aa5-0b1533e6bf30'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:52 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:52 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:52 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Deleted volume successfully. Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3e1e4c24-87e7-4c66-a14b-763688ccfc24 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-b03e253f-0cda-4fab-8787-a82def8e1ab6-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f37c4e-a4fb-4d08-b614-88acc17ea4fc]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:52 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda Sep 02 00:55:52 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:52 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:52 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda Sep 02 00:55:52 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:53 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda" returned: 0 in 0.252s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda" released by "delete_volume" :: held 0.651s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created reservations ['8548bf9d-babf-4031-86e9-1985a6db72b2', '0e36d0e1-1376-4bcc-955c-bcb8cd459888', 'a996063b-ab70-454e-8d35-d0a1e76311db', '61a8d370-a873-480f-92a4-2ec4a26e7ee7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:53 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:53 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:53 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Deleted volume successfully. Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fd5df61-2a16-4df5-8a47-eccc3f5e5177 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-fa5c35f6-bb24-4a7f-a94a-7e76695cfbda-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-c62c787e-751d-476c-b73a-bd75654a392b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-c62c787e-751d-476c-b73a-bd75654a392b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-c62c787e-751d-476c-b73a-bd75654a392b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-c62c787e-751d-476c-b73a-bd75654a392b" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9835571-4293-4e05-bb12-596ce9afc36e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:53 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b Sep 02 00:55:53 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:54 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:54 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b Sep 02 00:55:54 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:54 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c62c787e-751d-476c-b73a-bd75654a392b" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-c62c787e-751d-476c-b73a-bd75654a392b" released by "delete_volume" :: held 0.645s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Created reservations ['ea41f49f-be5f-4b3d-b769-bbfad61ad78a', '2d691e71-3779-4c4c-83c1-601a1c8104f6', 'eeda84c4-7fe7-4983-97ce-29c387b04651', '443b29fe-44b0-4053-ba37-442691292479'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:54 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:54 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:54 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Deleted volume successfully. Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c383f090-76a0-48bf-b69e-87c8ca8bf4ad tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-c62c787e-751d-476c-b73a-bd75654a392b-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-647752a8-060c-47f7-ae0b-aa385b78c1ee-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-647752a8-060c-47f7-ae0b-aa385b78c1ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-647752a8-060c-47f7-ae0b-aa385b78c1ee" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-647752a8-060c-47f7-ae0b-aa385b78c1ee" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[45626ff1-b3a7-41f2-bbb6-e39177ec5b3c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:54 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee Sep 02 00:55:54 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:55 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:55 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee Sep 02 00:55:55 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:55 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-647752a8-060c-47f7-ae0b-aa385b78c1ee" returned: 0 in 0.235s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-647752a8-060c-47f7-ae0b-aa385b78c1ee" released by "delete_volume" :: held 0.611s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created reservations ['d3fac8cc-d216-4795-81fa-d09a4793bbb0', '170aa8cf-28ae-4bf1-aecd-df38010c464e', 'e3adcad1-d534-47db-8748-6fae35564615', 'cca4bdcd-4690-49b3-a724-371024b62515'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=71,cinder:INSERT=26,cinder:UPDATE=84,cinder:DELETE=9 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:55 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:55 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:55 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.244s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Deleted volume successfully. Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a06399d8-5af1-4046-a0a7-91ceddecba84 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-647752a8-060c-47f7-ae0b-aa385b78c1ee-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-c3e6e336-ad5a-4047-aa34-591904ca41ae-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-c3e6e336-ad5a-4047-aa34-591904ca41ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-af674a1a-bc86-4dc8-95df-d7537e038421" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-af674a1a-bc86-4dc8-95df-d7537e038421" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-c3e6e336-ad5a-4047-aa34-591904ca41ae" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-c3e6e336-ad5a-4047-aa34-591904ca41ae" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Deleting offline snapshot c3e6e336-ad5a-4047-aa34-591904ca41ae of volume af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] snapshot_file for this snap is: volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b548eb30-a5fd-4a72-b0a6-0e219747ed1d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:56 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae Sep 02 00:55:56 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:56 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af674a1a-bc86-4dc8-95df-d7537e038421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:55:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3f1bae-109a-449c-b6b1-826fa0ea0cc0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:56 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 Sep 02 00:55:56 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:56 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:56 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae Sep 02 00:55:56 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:57 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:57 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae Sep 02 00:55:57 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:57 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421.c3e6e336-ad5a-4047-aa34-591904ca41ae" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=78,cinder:UPDATE=88,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-c3e6e336-ad5a-4047-aa34-591904ca41ae" released by "_delete_snapshot" :: held 1.370s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-af674a1a-bc86-4dc8-95df-d7537e038421" released by "delete_snapshot" :: held 1.392s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created reservations ['906e8176-7d95-4aea-b763-3382bd14ffa7', '46130ee5-867d-4afb-8af2-db0b44da5469', '9b0fb36c-c076-4593-8962-9bf20b3e89f5', 'fd10c95e-bc88-4159-afa8-d6865adffbff'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Delete snapshot completed successfully. Sep 02 00:55:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8342f21-1b8a-44ac-9f83-44689d581ea1 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-c3e6e336-ad5a-4047-aa34-591904ca41ae-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-af674a1a-bc86-4dc8-95df-d7537e038421-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-af674a1a-bc86-4dc8-95df-d7537e038421-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "cinder-quobyte-af674a1a-bc86-4dc8-95df-d7537e038421" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-af674a1a-bc86-4dc8-95df-d7537e038421" acquired by "delete_volume" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8896f54-c04d-48d6-9b73-fa401d121095]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:58 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 Sep 02 00:55:58 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:58 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:58 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421 Sep 02 00:55:58 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:58 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-af674a1a-bc86-4dc8-95df-d7537e038421" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-quobyte-af674a1a-bc86-4dc8-95df-d7537e038421" released by "delete_volume" :: held 0.669s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Created reservations ['0374071a-fc84-4e49-910e-5f54aa8b79e2', '35f854e5-2af8-4a4b-9d59-e4754c0ee8e9', 'ba75b21d-cc81-455b-a3c3-e58f5e688589', '1547b132-14c5-4212-a16c-28eb38f8ae85'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:55:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:55:58 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:55:58 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:55:59 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 02 00:55:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.250s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:55:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:55:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Deleted volume successfully. Sep 02 00:55:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6320af0f-96e7-4029-8738-ed50c939b434 tempest-CreateVolumesFromSnapshotTest-958170011 None] Lock "cinder-af674a1a-bc86-4dc8-95df-d7537e038421-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Flow 'volume_create_manager' (ceef738f-b1ca-4cab-9f30-0abd95408591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b485f7cd-87b3-4bc0-bd0b-d629922f3e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b485f7cd-87b3-4bc0-bd0b-d629922f3e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-221213929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd5e35e-64c9-41f9-8900-c8f5827fc02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604960a63cb54ad2a90dd73c2c013ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:02Z,use_quota=True,user_id='24f46b2c64a9400ea9e1666e4343dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7db31a-a6da-43a6-a406-39429ac13aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7db31a-a6da-43a6-a406-39429ac13aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bbe7f9-09d2-4b42-aa5e-05f6b54cac7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bbe7f9-09d2-4b42-aa5e-05f6b54cac7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd5e35e-64c9-41f9-8900-c8f5827fc02b', 'volume_name': 'volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cb452d-4d9d-491a-a63c-05902d259709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5cb452d-4d9d-491a-a63c-05902d259709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e42956-be57-430f-b232-7d3db0698482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Volume afd5e35e-64c9-41f9-8900-c8f5827fc02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b', 'volume_size': 1} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-221213929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd5e35e-64c9-41f9-8900-c8f5827fc02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604960a63cb54ad2a90dd73c2c013ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:02Z,use_quota=True,user_id='24f46b2c64a9400ea9e1666e4343dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Creating volume afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:02 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b 1073741824 Sep 02 00:56:02 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:02 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b 1073741824" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:02 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b Sep 02 00:56:02 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:02 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b" returned: 0 in 0.245s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e42956-be57-430f-b232-7d3db0698482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b20991-0918-42c6-a1f7-5ebfb251b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Volume volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b (afd5e35e-64c9-41f9-8900-c8f5827fc02b): created successfully Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b20991-0918-42c6-a1f7-5ebfb251b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Flow 'volume_create_manager' (ceef738f-b1ca-4cab-9f30-0abd95408591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d2625b7b-3792-495d-94a2-009ce1659aa1 tempest-VolumeDependencyTests-491302168 None] Created volume successfully. Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Creating offline snapshot ec5f0850-5cff-42bd-9354-c9260167486d of volume afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c6158-f067-486f-b463-1b032b46f767]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:03 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b Sep 02 00:56:03 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:03 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b" returned: 0 in 0.353s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:03 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d 1G Sep 02 00:56:03 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:03 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d 1G" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:03 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d Sep 02 00:56:03 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:04 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:04 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d is being set with open permissions: ugo+rw Sep 02 00:56:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:04 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d Sep 02 00:56:04 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:04 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d" returned: 0 in 0.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:04 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.info Sep 02 00:56:04 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:04 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.info" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:04 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.info is being set with open permissions: ugo+rw Sep 02 00:56:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:04 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.info Sep 02 00:56:04 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:05 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.info" returned: 0 in 0.232s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f85e561f-1125-4363-8a42-b1b537240e2d tempest-VolumeDependencyTests-491302168 None] Create snapshot completed successfully Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Flow 'volume_create_manager' (259fffa9-75af-4875-a0e0-cdcda22a95d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45c8c24-6396-4d13-b1aa-f1ac31e603e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45c8c24-6396-4d13-b1aa-f1ac31e603e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1607696874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab60a98-9902-4233-858f-5108d0b4d6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604960a63cb54ad2a90dd73c2c013ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec5f0850-5cff-42bd-9354-c9260167486d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:06Z,use_quota=True,user_id='24f46b2c64a9400ea9e1666e4343dda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9787990-3118-4c45-a161-8a2a30e247a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9787990-3118-4c45-a161-8a2a30e247a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c035341-b980-4a07-b382-af01f6cfa3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c035341-b980-4a07-b382-af01f6cfa3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dab60a98-9902-4233-858f-5108d0b4d6b9', 'volume_name': 'volume-dab60a98-9902-4233-858f-5108d0b4d6b9', 'volume_size': 1, 'snapshot_id': 'ec5f0850-5cff-42bd-9354-c9260167486d'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44706378-98ea-4a11-96e8-748fa496b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44706378-98ea-4a11-96e8-748fa496b007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693bf4ac-9371-4420-80d0-1bc738f86e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Volume dab60a98-9902-4233-858f-5108d0b4d6b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dab60a98-9902-4233-858f-5108d0b4d6b9', 'volume_size': 1, 'snapshot_id': 'ec5f0850-5cff-42bd-9354-c9260167486d'} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-quobyte-ec5f0850-5cff-42bd-9354-c9260167486d-dab60a98-9902-4233-858f-5108d0b4d6b9" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-ec5f0850-5cff-42bd-9354-c9260167486d-dab60a98-9902-4233-858f-5108d0b4d6b9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Creating volume dab60a98-9902-4233-858f-5108d0b4d6b9 from snapshot ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-quobyte-dab60a98-9902-4233-858f-5108d0b4d6b9" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-dab60a98-9902-4233-858f-5108d0b4d6b9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] snapshot: ec5f0850-5cff-42bd-9354-c9260167486d, volume: dab60a98-9902-4233-858f-5108d0b4d6b9, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ee201-d49d-40fa-b16d-2a3eb697edf6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:06 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d Sep 02 00:56:06 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:06 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d" returned: 0 in 0.360s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d050e390-edbc-4aad-96b8-3bbc496623e3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:06 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b Sep 02 00:56:06 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:06 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:56:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:06 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 Sep 02 00:56:06 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:10 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9" returned: 0 in 4.210s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:10 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:56:10 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Converted 1024.00 MB image at 243.14 MB/s Sep 02 00:56:10 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 is being set with open permissions: ugo+rw Sep 02 00:56:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:10 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 Sep 02 00:56:10 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:11 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9" returned: 0 in 0.237s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-dab60a98-9902-4233-858f-5108d0b4d6b9" released by "_copy_volume_from_snapshot" :: held 5.234s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-ec5f0850-5cff-42bd-9354-c9260167486d-dab60a98-9902-4233-858f-5108d0b4d6b9" released by "_create_volume_from_snapshot" :: held 5.294s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.308s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693bf4ac-9371-4420-80d0-1bc738f86e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab60a98-9902-4233-858f-5108d0b4d6b9', 'volume_size': 1, 'snapshot_id': 'ec5f0850-5cff-42bd-9354-c9260167486d'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb02660f-45d1-4fd1-82a0-6e27a2357ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Volume volume-dab60a98-9902-4233-858f-5108d0b4d6b9 (dab60a98-9902-4233-858f-5108d0b4d6b9): created successfully Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb02660f-45d1-4fd1-82a0-6e27a2357ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Flow 'volume_create_manager' (259fffa9-75af-4875-a0e0-cdcda22a95d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-40e765b1-9db7-466a-8d60-1de6c47e894b tempest-VolumeDependencyTests-491302168 None] Created volume successfully. Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:12 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:12 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-ec5f0850-5cff-42bd-9354-c9260167486d-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Lock "cinder-ec5f0850-5cff-42bd-9354-c9260167486d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-quobyte-afd5e35e-64c9-41f9-8900-c8f5827fc02b" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-afd5e35e-64c9-41f9-8900-c8f5827fc02b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-quobyte-ec5f0850-5cff-42bd-9354-c9260167486d" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-ec5f0850-5cff-42bd-9354-c9260167486d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Deleting offline snapshot ec5f0850-5cff-42bd-9354-c9260167486d of volume afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] snapshot_file for this snap is: volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d122752b-a911-46a4-965e-6429157a65da]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:12 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:56:12 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d Sep 02 00:56:12 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:12 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[48885bc6-de06-4c1b-b2b5-a19de668b080]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:12 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b Sep 02 00:56:12 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:13 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b" returned: 0 in 0.501s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:13 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d Sep 02 00:56:13 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:13 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:13 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d Sep 02 00:56:13 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:13 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b.ec5f0850-5cff-42bd-9354-c9260167486d" returned: 0 in 0.238s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-ec5f0850-5cff-42bd-9354-c9260167486d" released by "_delete_snapshot" :: held 1.514s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-afd5e35e-64c9-41f9-8900-c8f5827fc02b" released by "delete_snapshot" :: held 1.538s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Created reservations ['28152ae2-129d-4ac4-8c64-03473a1dec91', 'f63f8905-daeb-496b-903c-ef176b53a2dc', '3f32c90b-8cd8-4c05-96a0-79bbb12d86c9', '24390b8c-2b28-47fe-bfc6-285f5e03e291'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Delete snapshot completed successfully. Sep 02 00:56:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-15a834f2-3dcc-41a5-8fb4-d3df45b18cbd tempest-VolumeDependencyTests-491302168 None] Lock "cinder-ec5f0850-5cff-42bd-9354-c9260167486d-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-afd5e35e-64c9-41f9-8900-c8f5827fc02b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Lock "cinder-afd5e35e-64c9-41f9-8900-c8f5827fc02b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-quobyte-afd5e35e-64c9-41f9-8900-c8f5827fc02b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-afd5e35e-64c9-41f9-8900-c8f5827fc02b" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc32761-0133-4cbe-913f-b769b6dbacb3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:14 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b Sep 02 00:56:14 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:14 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b" returned: 0 in 0.353s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:14 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b Sep 02 00:56:14 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:15 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-afd5e35e-64c9-41f9-8900-c8f5827fc02b" returned: 0 in 0.238s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-afd5e35e-64c9-41f9-8900-c8f5827fc02b" released by "delete_volume" :: held 0.643s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Created reservations ['ed997759-33c7-4e17-9ea2-e2ca7e07ebe4', '8917692e-c143-452b-b051-c1327a35f8d4', '2120af31-0381-4392-beb0-47113e9990bf', '8a678ba2-9ab9-4a30-926f-0e7c1d2c9b0d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:15 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:15 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:15 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.236s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Deleted volume successfully. Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8fd41c9c-5b38-4dec-a374-28ba25e41c5d tempest-VolumeDependencyTests-491302168 None] Lock "cinder-afd5e35e-64c9-41f9-8900-c8f5827fc02b-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-dab60a98-9902-4233-858f-5108d0b4d6b9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Lock "cinder-dab60a98-9902-4233-858f-5108d0b4d6b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Acquiring lock "cinder-quobyte-dab60a98-9902-4233-858f-5108d0b4d6b9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-dab60a98-9902-4233-858f-5108d0b4d6b9" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6604b-ddc5-4acf-8ea6-1ef232b2d51d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:15 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 Sep 02 00:56:15 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:16 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9" returned: 0 in 0.347s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:16 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9 Sep 02 00:56:16 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:16 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dab60a98-9902-4233-858f-5108d0b4d6b9" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Lock "cinder-quobyte-dab60a98-9902-4233-858f-5108d0b4d6b9" released by "delete_volume" :: held 0.632s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Created reservations ['36f90d76-abd9-496a-b18c-d16d73c03bcc', '373dd1b5-86aa-426c-8366-93b9bbebb51b', 'd3dacfdb-a3b0-412b-8f5c-05277a4e3d2e', '3721c019-6c6e-4318-8e60-e290cb806bbf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:16 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:16 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:16 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.247s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Deleted volume successfully. Sep 02 00:56:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e50d228c-025b-4945-a5a2-0c000967f6cc tempest-VolumeDependencyTests-491302168 None] Lock "cinder-dab60a98-9902-4233-858f-5108d0b4d6b9-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-80230892-29e7-4ed7-9a39-51b9bc2ab951 req-23af9a72-0f50-4591-810f-363ab21ff197 tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-80230892-29e7-4ed7-9a39-51b9bc2ab951 req-23af9a72-0f50-4591-810f-363ab21ff197 tempest-TestStampPattern-1388898446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-80230892-29e7-4ed7-9a39-51b9bc2ab951 req-23af9a72-0f50-4591-810f-363ab21ff197 tempest-TestStampPattern-1388898446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-80230892-29e7-4ed7-9a39-51b9bc2ab951 req-23af9a72-0f50-4591-810f-363ab21ff197 tempest-TestStampPattern-1388898446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1', 'name': 'volume-20ef1f6f-1d39-42fb-b49f-72350a427bab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5661e394-27e0-420b-85bc-d4db4f4d4dbd', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 02 00:56:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-80230892-29e7-4ed7-9a39-51b9bc2ab951 req-23af9a72-0f50-4591-810f-363ab21ff197 tempest-TestStampPattern-1388898446 None] attachment_update completed successfully. Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Flow 'volume_create_manager' (7adcfec8-005b-42d1-91d9-d12aacfa3214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4c3331-23a2-4360-8885-f047c74ae452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4c3331-23a2-4360-8885-f047c74ae452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9735188d-73e4-4592-bc82-9a39263513d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f289f863f2044a6b3362aaa98a1661f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:22Z,use_quota=True,user_id='5a88b85f07aa4938b90a46a03748f4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526fe89b-bd2f-45f6-a897-a47ad052c4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526fe89b-bd2f-45f6-a897-a47ad052c4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff438cd8-e464-4306-b4c6-145559932b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:21 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff438cd8-e464-4306-b4c6-145559932b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9735188d-73e4-4592-bc82-9a39263513d3', 'volume_name': 'volume-9735188d-73e4-4592-bc82-9a39263513d3', 'volume_size': 1, 'image_id': 'b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dc7e21452223514e75a7904566f4c2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f289f863f2044a6b3362aaa98a1661f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7eba16e9e71325689088bbd1db674b63eea7dabd934430ad7bdc681d5e84312416aed5165420b33def9f45e7caee8b315de4375ddad6df153e50540d86ff608', 'id': 'b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'created_at': datetime.datetime(2026, 9, 1, 22, 56, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 56, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5478eef-d607-4407-bb74-e02a7f24c15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5478eef-d607-4407-bb74-e02a7f24c15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df436bf-0891-4072-b798-587b96fa69e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Volume 9735188d-73e4-4592-bc82-9a39263513d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9735188d-73e4-4592-bc82-9a39263513d3', 'volume_size': 1, 'image_id': 'b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dc7e21452223514e75a7904566f4c2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f289f863f2044a6b3362aaa98a1661f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7eba16e9e71325689088bbd1db674b63eea7dabd934430ad7bdc681d5e84312416aed5165420b33def9f45e7caee8b315de4375ddad6df153e50540d86ff608', 'id': 'b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'created_at': datetime.datetime(2026, 9, 1, 22, 56, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 56, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f/file', 'properties': {}}, 'image_service': } Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Trying to clone 9735188d-73e4-4592-bc82-9a39263513d3 from image b2bd9b37-f545-43c3-baf5-b1073ba58e8f at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:56:22 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fcf4bc-45d3-43c3-87f9-b5a5d0169658]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:22 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD Sep 02 00:56:22 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:22 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:22 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD Sep 02 00:56:22 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:23 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Temporary image b2bd9b37-f545-43c3-baf5-b1073ba58e8f is fetched for user 5a88b85f07aa4938b90a46a03748f4f1. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:56:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-6e372d9a-caf0-48c0-accf-b4596adb8391 req-3e83f04f-a579-4a42-9a6c-c85814ec5e53 tempest-TestStampPattern-1388898446 None] Terminate volume connection completed successfully. Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-6e372d9a-caf0-48c0-accf-b4596adb8391 req-3e83f04f-a579-4a42-9a6c-c85814ec5e53 tempest-TestStampPattern-1388898446 None] Deleting attachment 5661e394-27e0-420b-85bc-d4db4f4d4dbd. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[06691d8e-066c-4dcd-8dd0-df65c3df1a82]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:23 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD Sep 02 00:56:23 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:23 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:23 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD Sep 02 00:56:23 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:23 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9735188d-73e4-4592-bc82-9a39263513d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f289f863f2044a6b3362aaa98a1661f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:22Z,use_quota=True,user_id='5a88b85f07aa4938b90a46a03748f4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Creating volume 9735188d-73e4-4592-bc82-9a39263513d3 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:23 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 1073741824 Sep 02 00:56:23 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:24 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 1073741824" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:24 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 Sep 02 00:56:24 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:24 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Attempting download of b2bd9b37-f545-43c3-baf5-b1073ba58e8f ((None, [{'url': 'file:///opt/stack/data/glance/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'metadata': {}}])) to volume 9735188d-73e4-4592-bc82-9a39263513d3. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb69c5f9-8deb-4774-9a2c-1514cf006e60]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2bd9b37-f545-43c3-baf5-b1073ba58e8f__ihak_5r {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:24 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2bd9b37-f545-43c3-baf5-b1073ba58e8f__ihak_5r Sep 02 00:56:24 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:25 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2bd9b37-f545-43c3-baf5-b1073ba58e8f__ihak_5r" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2bd9b37-f545-43c3-baf5-b1073ba58e8f__ihak_5r {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:25 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2bd9b37-f545-43c3-baf5-b1073ba58e8f__ihak_5r Sep 02 00:56:25 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:25 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2bd9b37-f545-43c3-baf5-b1073ba58e8f__ihak_5r" returned: 1 in 0.482s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2bd9b37-f545-43c3-baf5-b1073ba58e8f__ihak_5r' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:56:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23aa21a-e1a5-4490-85eb-fc26858e1012]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:25 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD Sep 02 00:56:25 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:26 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:26 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD Sep 02 00:56:26 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:26 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] b2bd9b37-f545-43c3-baf5-b1073ba58e8f was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:26 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 Sep 02 00:56:26 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:26 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3" returned: 0 in 0.498s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2bd9b37-f545-43c3-baf5-b1073ba58e8f_wbomx0fddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:56:26 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:56:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:26 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 1G Sep 02 00:56:26 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:27 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 1G" returned: 0 in 0.293s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Downloaded image b2bd9b37-f545-43c3-baf5-b1073ba58e8f ((None, [{'url': 'file:///opt/stack/data/glance/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'metadata': {}}])) to volume 9735188d-73e4-4592-bc82-9a39263513d3 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Temporary image b2bd9b37-f545-43c3-baf5-b1073ba58e8f for user 5a88b85f07aa4938b90a46a03748f4f1 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Marking volume 9735188d-73e4-4592-bc82-9a39263513d3 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Copying metadata from image b2bd9b37-f545-43c3-baf5-b1073ba58e8f to 9735188d-73e4-4592-bc82-9a39263513d3. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Creating volume glance metadata for volume 9735188d-73e4-4592-bc82-9a39263513d3 backed by image b2bd9b37-f545-43c3-baf5-b1073ba58e8f with: {'image_id': 'b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4dc7e21452223514e75a7904566f4c2e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df436bf-0891-4072-b798-587b96fa69e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9735188d-73e4-4592-bc82-9a39263513d3', 'volume_size': 1, 'image_id': 'b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dc7e21452223514e75a7904566f4c2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f289f863f2044a6b3362aaa98a1661f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7eba16e9e71325689088bbd1db674b63eea7dabd934430ad7bdc681d5e84312416aed5165420b33def9f45e7caee8b315de4375ddad6df153e50540d86ff608', 'id': 'b2bd9b37-f545-43c3-baf5-b1073ba58e8f', 'created_at': datetime.datetime(2026, 9, 1, 22, 56, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 56, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2bd9b37-f545-43c3-baf5-b1073ba58e8f/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323bfd0b-cedf-4c04-8078-e74d31d4903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:27 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Volume volume-9735188d-73e4-4592-bc82-9a39263513d3 (9735188d-73e4-4592-bc82-9a39263513d3): created successfully Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323bfd0b-cedf-4c04-8078-e74d31d4903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Flow 'volume_create_manager' (7adcfec8-005b-42d1-91d9-d12aacfa3214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3f3e6350-005f-4456-8987-a12fc7c954b8 tempest-VolumeImageDependencyTests-379507089 None] Created volume successfully. Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-20ef1f6f-1d39-42fb-b49f-72350a427bab-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Lock "cinder-20ef1f6f-1d39-42fb-b49f-72350a427bab-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-quobyte-20ef1f6f-1d39-42fb-b49f-72350a427bab" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-20ef1f6f-1d39-42fb-b49f-72350a427bab" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cc1fba-72c5-4b4d-830b-f841131cbc3a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:27 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab Sep 02 00:56:27 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:28 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:28 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab Sep 02 00:56:28 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Acquiring lock "cinder-9735188d-73e4-4592-bc82-9a39263513d3-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Lock "cinder-9735188d-73e4-4592-bc82-9a39263513d3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:28 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-20ef1f6f-1d39-42fb-b49f-72350a427bab" returned: 0 in 0.264s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-20ef1f6f-1d39-42fb-b49f-72350a427bab" released by "delete_volume" :: held 0.652s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Acquiring lock "cinder-quobyte-9735188d-73e4-4592-bc82-9a39263513d3" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Lock "cinder-quobyte-9735188d-73e4-4592-bc82-9a39263513d3" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a3d855-f642-4328-941d-8f93a7210a36]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Created reservations ['722e4362-6a7e-44ee-8557-a161faf085ae', '5d67598d-4a68-44d8-a3a2-91af1ede8a4e', '8fc5482f-a8be-48ea-9396-cd7b48d87bce', '2e66f222-58df-419a-94a1-fd6e97d6aa99'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:28 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:28 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 Sep 02 00:56:28 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:28 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:28 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Deleted volume successfully. Sep 02 00:56:28 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afcdec52-8404-47c5-a976-de20616fe7b8 tempest-TestStampPattern-1388898446 None] Lock "cinder-20ef1f6f-1d39-42fb-b49f-72350a427bab-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:28 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3 Sep 02 00:56:28 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-67d40a7c-93c9-4b5f-9991-7ac958d2abac-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:29 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9735188d-73e4-4592-bc82-9a39263513d3" returned: 0 in 0.273s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Lock "cinder-quobyte-9735188d-73e4-4592-bc82-9a39263513d3" released by "delete_volume" :: held 0.708s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Lock "cinder-67d40a7c-93c9-4b5f-9991-7ac958d2abac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-quobyte-66693239-a2c0-471b-b852-ade3e97b0b69" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-66693239-a2c0-471b-b852-ade3e97b0b69" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-quobyte-67d40a7c-93c9-4b5f-9991-7ac958d2abac" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-67d40a7c-93c9-4b5f-9991-7ac958d2abac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Deleting offline snapshot 67d40a7c-93c9-4b5f-9991-7ac958d2abac of volume 66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] snapshot_file for this snap is: volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[85410200-5e13-48d8-8a38-fe83ecbcdfc1]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Created reservations ['b32d3373-4ef7-40bd-837d-d273412bec2e', '985f378c-39f0-4bfb-92db-ad4ae0a3e3b6', '3bee1d83-a0a7-4a2d-8de3-bd7bf463bb69', 'b0cdc412-2e33-4109-9ae9-d60d6ef05f40'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:29 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac Sep 02 00:56:29 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:29 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:29 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:29 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.281s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Deleted volume successfully. Sep 02 00:56:29 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e0cda733-1bda-4cee-9675-ac6c5fe59d73 tempest-VolumeImageDependencyTests-379507089 None] Lock "cinder-9735188d-73e4-4592-bc82-9a39263513d3-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac" returned: 0 in 0.425s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66693239-a2c0-471b-b852-ade3e97b0b69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28dda73-a71f-4d53-84f8-88e1a66644eb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:29 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 Sep 02 00:56:29 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:30 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:30 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac Sep 02 00:56:30 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:30 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:30 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac Sep 02 00:56:30 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:30 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69.67d40a7c-93c9-4b5f-9991-7ac958d2abac" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-67d40a7c-93c9-4b5f-9991-7ac958d2abac" released by "_delete_snapshot" :: held 1.714s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-66693239-a2c0-471b-b852-ade3e97b0b69" released by "delete_snapshot" :: held 1.739s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Created reservations ['bc961373-e691-4e84-8f37-47ab2071bc20', 'aa5962b2-3390-4c3e-822f-06cb97d74da9', 'c2aa080e-3d0f-4208-8b6b-187b4579b23a', '92e0b100-f8e4-4aba-9c84-086b081a4dcc'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Delete snapshot completed successfully. Sep 02 00:56:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-425d6bf4-3829-41f7-b4fc-d61ff20ab665 tempest-TestStampPattern-1388898446 None] Lock "cinder-67d40a7c-93c9-4b5f-9991-7ac958d2abac-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-66693239-a2c0-471b-b852-ade3e97b0b69-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Lock "cinder-66693239-a2c0-471b-b852-ade3e97b0b69-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Acquiring lock "cinder-quobyte-66693239-a2c0-471b-b852-ade3e97b0b69" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-66693239-a2c0-471b-b852-ade3e97b0b69" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7ca10b-f25e-4dc3-bd6c-68d8cf7a6a86]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:35 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 Sep 02 00:56:35 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:35 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:35 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69 Sep 02 00:56:35 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:35 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-66693239-a2c0-471b-b852-ade3e97b0b69" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Lock "cinder-quobyte-66693239-a2c0-471b-b852-ade3e97b0b69" released by "delete_volume" :: held 0.684s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Created reservations ['3a1b5058-918e-4b9a-9c41-1018c1ee682c', '6e71ad33-1a3a-4065-bc11-a00cd2d485fa', '6563673e-9183-456e-985a-537125944e50', '3cc3664d-f273-494b-a58c-0b4dc446eb39'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:35 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:35 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:36 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:36 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Deleted volume successfully. Sep 02 00:56:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cedbe714-92c6-4db4-9be5-66ef217d02e7 tempest-TestStampPattern-1388898446 None] Lock "cinder-66693239-a2c0-471b-b852-ade3e97b0b69-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:45 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:DELETE=4,cinder:SELECT=68,cinder:INSERT=26,cinder:UPDATE=81 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:56:46 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=73,cinder:INSERT=23,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (6ab8c9a9-c657-4d7b-a083-cb52725a2575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628a3643-bd55-477a-ad0d-33a5e7438b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628a3643-bd55-477a-ad0d-33a5e7438b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357624560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59f8516-dd96-4c6b-90b6-1a36b70e72bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:47Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b79891f-ad20-4af1-a851-88ece3585542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b79891f-ad20-4af1-a851-88ece3585542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715a83bf-8425-42a5-b9c5-2f7d41f03176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715a83bf-8425-42a5-b9c5-2f7d41f03176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59f8516-dd96-4c6b-90b6-1a36b70e72bd', 'volume_name': 'volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c564b6f-4032-4d67-b0c9-542a954f01a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c564b6f-4032-4d67-b0c9-542a954f01a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83683671-2258-441d-b887-c8124e7452dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume c59f8516-dd96-4c6b-90b6-1a36b70e72bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd', 'volume_size': 1} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357624560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59f8516-dd96-4c6b-90b6-1a36b70e72bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:47Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Creating volume c59f8516-dd96-4c6b-90b6-1a36b70e72bd {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:47 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd 1073741824 Sep 02 00:56:47 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:47 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd 1073741824" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:47 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd Sep 02 00:56:47 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:47 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd" returned: 0 in 0.233s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83683671-2258-441d-b887-c8124e7452dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a1b23e-5073-4817-bc1d-2faac0237790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd (c59f8516-dd96-4c6b-90b6-1a36b70e72bd): created successfully Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a1b23e-5073-4817-bc1d-2faac0237790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (6ab8c9a9-c657-4d7b-a083-cb52725a2575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7ffb2096-6466-4d59-98f3-cac33b961ac5 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created volume successfully. Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (7253c808-afc1-4ba6-9cfe-4191ea9d5d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7763851a-5dce-4588-8eb3-195a0e31e509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7763851a-5dce-4588-8eb3-195a0e31e509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219073001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cc0942-8030-4b7e-a57a-bee6883289fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:49Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8539b63-dad7-4b82-bc80-6898eca09e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8539b63-dad7-4b82-bc80-6898eca09e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22a7e13-0072-4013-b726-1215efd8e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22a7e13-0072-4013-b726-1215efd8e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cc0942-8030-4b7e-a57a-bee6883289fb', 'volume_name': 'volume-c6cc0942-8030-4b7e-a57a-bee6883289fb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74efa3cb-70e8-4b8a-8ac4-c446ab15e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74efa3cb-70e8-4b8a-8ac4-c446ab15e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236ba08b-c483-4c2d-a291-65f80a82b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume c6cc0942-8030-4b7e-a57a-bee6883289fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cc0942-8030-4b7e-a57a-bee6883289fb', 'volume_size': 1} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1219073001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cc0942-8030-4b7e-a57a-bee6883289fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:49Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Creating volume c6cc0942-8030-4b7e-a57a-bee6883289fb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:48 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:48 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb 1073741824 Sep 02 00:56:48 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (3770648e-f7fa-4789-bac1-95e0bacc2151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1f54e6-bd8d-41d8-bc32-22f87e64b4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1f54e6-bd8d-41d8-bc32-22f87e64b4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188959096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312044f8-e98d-4f4a-b9a8-ac24db940866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:49Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287f7640-edd0-42c4-a3db-2a18215361e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287f7640-edd0-42c4-a3db-2a18215361e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a9ad6a-8ca0-4c58-9a33-40a3be48b773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a9ad6a-8ca0-4c58-9a33-40a3be48b773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312044f8-e98d-4f4a-b9a8-ac24db940866', 'volume_name': 'volume-312044f8-e98d-4f4a-b9a8-ac24db940866', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d51110-9496-4ac2-97c2-c20903dc6654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d51110-9496-4ac2-97c2-c20903dc6654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102750c-b34c-4335-9c19-3d0f8bcd1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume 312044f8-e98d-4f4a-b9a8-ac24db940866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312044f8-e98d-4f4a-b9a8-ac24db940866', 'volume_size': 1} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:49 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb 1073741824" returned: 0 in 0.472s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:49 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb Sep 02 00:56:49 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (727e933c-b8ef-4a1b-9c68-a011e3ffddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9bf81c-62e0-4545-be56-623cfa105e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9bf81c-62e0-4545-be56-623cfa105e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-599714252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f9d976-9ad4-4b47-b8a6-01e6c987d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:49Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6aa119-c809-4aec-8fdc-b885397828ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6aa119-c809-4aec-8fdc-b885397828ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91767794-8f22-442a-ab05-7786ddf69ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91767794-8f22-442a-ab05-7786ddf69ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f9d976-9ad4-4b47-b8a6-01e6c987d8ba', 'volume_name': 'volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d74705b-aa51-40e3-a4ae-f2e6c183dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d74705b-aa51-40e3-a4ae-f2e6c183dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b850878-b410-4665-a028-56f9ca91dd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume 58f9d976-9ad4-4b47-b8a6-01e6c987d8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba', 'volume_size': 1} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:49 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb" returned: 0 in 0.287s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188959096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312044f8-e98d-4f4a-b9a8-ac24db940866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:49Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Creating volume 312044f8-e98d-4f4a-b9a8-ac24db940866 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:49 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236ba08b-c483-4c2d-a291-65f80a82b506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cc0942-8030-4b7e-a57a-bee6883289fb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 1073741824 Sep 02 00:56:49 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2378bb8b-01cc-48b0-a8d0-e35d07228054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume volume-c6cc0942-8030-4b7e-a57a-bee6883289fb (c6cc0942-8030-4b7e-a57a-bee6883289fb): created successfully Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2378bb8b-01cc-48b0-a8d0-e35d07228054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (7253c808-afc1-4ba6-9cfe-4191ea9d5d1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-20dcef0a-d571-4d5a-90f7-a5eea601f721 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created volume successfully. Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (efb8353e-36d1-4dd0-8931-db9e6cad902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e9d272-f2e6-4df1-884f-c7947bc47d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e9d272-f2e6-4df1-884f-c7947bc47d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-119291315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f18817d-986b-4451-8ad2-8d2dca9de98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:50Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df4dbb5-fa3d-40ad-81d2-ea6d10248a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df4dbb5-fa3d-40ad-81d2-ea6d10248a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fa9969-103e-4e6f-a098-508baddcd998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fa9969-103e-4e6f-a098-508baddcd998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f18817d-986b-4451-8ad2-8d2dca9de98f', 'volume_name': 'volume-2f18817d-986b-4451-8ad2-8d2dca9de98f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ea942c-2c04-4948-9a4a-acd9b250175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ea942c-2c04-4948-9a4a-acd9b250175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea65ddff-8df3-4855-a243-94dce0e5feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume 2f18817d-986b-4451-8ad2-8d2dca9de98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f18817d-986b-4451-8ad2-8d2dca9de98f', 'volume_size': 1} Sep 02 00:56:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:50 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 1073741824" returned: 0 in 0.482s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:50 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 Sep 02 00:56:50 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (9db25a31-2ae8-4446-8c8f-5af0be3270bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36f3e78-6638-4433-9b5d-aaea88b7d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36f3e78-6638-4433-9b5d-aaea88b7d55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889125537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bb0bca-31e9-4554-9572-a525409b076c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:50Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e006871-2687-4b2d-9027-9af80f07f5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e006871-2687-4b2d-9027-9af80f07f5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7568a67b-f4e8-4022-a402-0eed860f8f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7568a67b-f4e8-4022-a402-0eed860f8f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55bb0bca-31e9-4554-9572-a525409b076c', 'volume_name': 'volume-55bb0bca-31e9-4554-9572-a525409b076c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc38d0e0-dfdd-47c0-a46a-105b8f33568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc38d0e0-dfdd-47c0-a46a-105b8f33568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843f53c2-1af3-4d27-b642-085109440092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume 55bb0bca-31e9-4554-9572-a525409b076c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55bb0bca-31e9-4554-9572-a525409b076c', 'volume_size': 1} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:50 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.852s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-599714252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f9d976-9ad4-4b47-b8a6-01e6c987d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:49Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Creating volume 58f9d976-9ad4-4b47-b8a6-01e6c987d8ba {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102750c-b34c-4335-9c19-3d0f8bcd1455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312044f8-e98d-4f4a-b9a8-ac24db940866', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba090f7-2285-4448-8389-c083278bd24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:50 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba 1073741824 Sep 02 00:56:50 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume volume-312044f8-e98d-4f4a-b9a8-ac24db940866 (312044f8-e98d-4f4a-b9a8-ac24db940866): created successfully Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba090f7-2285-4448-8389-c083278bd24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (3770648e-f7fa-4789-bac1-95e0bacc2151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-357cec92-a73b-4ce2-b20c-1c48897c70cf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created volume successfully. Sep 02 00:56:50 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba 1073741824" returned: 0 in 0.398s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:50 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba Sep 02 00:56:50 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:50 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-119291315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f18817d-986b-4451-8ad2-8d2dca9de98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:50Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Creating volume 2f18817d-986b-4451-8ad2-8d2dca9de98f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b850878-b410-4665-a028-56f9ca91dd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:51 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f 1073741824 Sep 02 00:56:51 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3897d02-934e-4031-88d4-314b9a199b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba (58f9d976-9ad4-4b47-b8a6-01e6c987d8ba): created successfully Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3897d02-934e-4031-88d4-314b9a199b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (727e933c-b8ef-4a1b-9c68-a011e3ffddc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bfd08525-e393-4dad-b6eb-21065af08b7a tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created volume successfully. Sep 02 00:56:51 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f 1073741824" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:51 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f Sep 02 00:56:51 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:51 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f" returned: 0 in 0.237s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889125537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bb0bca-31e9-4554-9572-a525409b076c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b713949a189b42d991d3848e97a623dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:56:50Z,use_quota=True,user_id='e517ebbeeabf403e8ba23a74187df9db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Creating volume 55bb0bca-31e9-4554-9572-a525409b076c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:56:51 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea65ddff-8df3-4855-a243-94dce0e5feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f18817d-986b-4451-8ad2-8d2dca9de98f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:51 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c 1073741824 Sep 02 00:56:51 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac43308-aca4-4cb6-b314-f205500cff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume volume-2f18817d-986b-4451-8ad2-8d2dca9de98f (2f18817d-986b-4451-8ad2-8d2dca9de98f): created successfully Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac43308-aca4-4cb6-b314-f205500cff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (efb8353e-36d1-4dd0-8931-db9e6cad902b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-17efecb2-4d3b-4189-8774-77113fd30a4b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created volume successfully. Sep 02 00:56:52 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c 1073741824" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:52 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c Sep 02 00:56:52 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:52 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c" returned: 0 in 0.243s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843f53c2-1af3-4d27-b642-085109440092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55bb0bca-31e9-4554-9572-a525409b076c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a1b937-ad1a-4f4b-b19c-803cd064a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:56:52 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Volume volume-55bb0bca-31e9-4554-9572-a525409b076c (55bb0bca-31e9-4554-9572-a525409b076c): created successfully Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a1b937-ad1a-4f4b-b19c-803cd064a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:56:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Flow 'volume_create_manager' (9db25a31-2ae8-4446-8c8f-5af0be3270bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:56:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-534c4f9a-58db-446d-a90d-b28aeb55652b tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created volume successfully. Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-55bb0bca-31e9-4554-9572-a525409b076c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-55bb0bca-31e9-4554-9572-a525409b076c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-quobyte-55bb0bca-31e9-4554-9572-a525409b076c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-55bb0bca-31e9-4554-9572-a525409b076c" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[04491f5a-bc99-436d-bb16-ef89003f6a5e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:53 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c Sep 02 00:56:53 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:53 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c" returned: 0 in 0.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:53 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c Sep 02 00:56:53 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:54 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-55bb0bca-31e9-4554-9572-a525409b076c" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-55bb0bca-31e9-4554-9572-a525409b076c" released by "delete_volume" :: held 0.621s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created reservations ['53c8d9e2-759d-447f-a192-ff56761f0dc2', '608dc3e2-2905-4f72-b5db-7351d787d3b6', 'c9537609-cfb8-458b-b796-461d0b621c91', 'c9c5a0b6-23d9-46e6-942f-e34ea59aaf6e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:54 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:54 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:54 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.245s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Deleted volume successfully. Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b2f1b8c8-c467-400b-a306-26d3db59a770 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-55bb0bca-31e9-4554-9572-a525409b076c-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-2f18817d-986b-4451-8ad2-8d2dca9de98f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-2f18817d-986b-4451-8ad2-8d2dca9de98f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-quobyte-2f18817d-986b-4451-8ad2-8d2dca9de98f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-2f18817d-986b-4451-8ad2-8d2dca9de98f" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[113e5f93-2c54-4300-895c-5e51c8357baa]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:54 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f Sep 02 00:56:54 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:55 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:55 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f Sep 02 00:56:55 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:55 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2f18817d-986b-4451-8ad2-8d2dca9de98f" returned: 0 in 0.235s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-2f18817d-986b-4451-8ad2-8d2dca9de98f" released by "delete_volume" :: held 0.617s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created reservations ['93fe3608-0c91-4630-acca-c8f29a894810', '94d1e1b6-0b1d-47c2-bda2-07d9cefb706a', '31c70acf-540c-4564-8167-10c4f6b7b940', 'd3ea4399-b5f6-497f-924f-7853b95465ef'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:55 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:55 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:55 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Deleted volume successfully. Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84c73c23-6ca6-4bdf-862d-2ff145d6bc0e tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-2f18817d-986b-4451-8ad2-8d2dca9de98f-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-quobyte-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ad1abf-2518-4a50-baea-0c6511b18079]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:55 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba Sep 02 00:56:55 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:56 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:56 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba Sep 02 00:56:56 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:56 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba" returned: 0 in 0.238s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba" released by "delete_volume" :: held 0.617s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created reservations ['ee898f98-c54b-4c3e-9312-dd92f99ab4c3', 'dad7c8c4-2e58-4684-931e-31436e657b50', '1c319aa1-f875-4418-897f-e43a5cddf26b', '5e39a491-ae4a-4273-9be0-4a76745aa083'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:56 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:56 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:56 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Deleted volume successfully. Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-72a5f59c-bae0-4ed7-b617-933be3ed70d2 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-58f9d976-9ad4-4b47-b8a6-01e6c987d8ba-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-312044f8-e98d-4f4a-b9a8-ac24db940866-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-312044f8-e98d-4f4a-b9a8-ac24db940866-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-quobyte-312044f8-e98d-4f4a-b9a8-ac24db940866" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-312044f8-e98d-4f4a-b9a8-ac24db940866" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384589b-aa10-4e13-a037-fe2b56aee53d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:57 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 Sep 02 00:56:57 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:57 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:57 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866 Sep 02 00:56:57 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:57 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-312044f8-e98d-4f4a-b9a8-ac24db940866" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-312044f8-e98d-4f4a-b9a8-ac24db940866" released by "delete_volume" :: held 0.617s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created reservations ['846af4a2-d5d3-4ceb-b872-2495522875ac', '4b19e89c-997a-4c65-b167-be4121f833b8', 'e8698610-3333-4e9a-ae46-c45517fe8994', '28fe547b-0fcf-4f9a-bbdf-7bec788ca5a8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:57 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:57 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:57 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Deleted volume successfully. Sep 02 00:56:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81470996-840c-4174-90f7-7be06c362dcf tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-312044f8-e98d-4f4a-b9a8-ac24db940866-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-c6cc0942-8030-4b7e-a57a-bee6883289fb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-c6cc0942-8030-4b7e-a57a-bee6883289fb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-quobyte-c6cc0942-8030-4b7e-a57a-bee6883289fb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-c6cc0942-8030-4b7e-a57a-bee6883289fb" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[58277664-53f1-4a27-b1a8-e5e5eaa50618]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:58 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb Sep 02 00:56:58 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:58 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:58 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb Sep 02 00:56:58 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:58 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c6cc0942-8030-4b7e-a57a-bee6883289fb" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-c6cc0942-8030-4b7e-a57a-bee6883289fb" released by "delete_volume" :: held 0.634s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created reservations ['ddab78f5-2675-449d-bddc-1209b2b52d33', 'd6694867-2d2f-4216-9046-d56e2973b623', 'c6b1a83f-16a8-430f-a2b8-33a135b5996f', '89d2e0c5-c58c-495a-8740-f63e68083908'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:56:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:58 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:56:58 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:59 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:56:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Deleted volume successfully. Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1b58762-dca2-4d0e-b69b-8a93f1249943 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-c6cc0942-8030-4b7e-a57a-bee6883289fb-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-c59f8516-dd96-4c6b-90b6-1a36b70e72bd-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-c59f8516-dd96-4c6b-90b6-1a36b70e72bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "cinder-quobyte-c59f8516-dd96-4c6b-90b6-1a36b70e72bd" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-c59f8516-dd96-4c6b-90b6-1a36b70e72bd" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b70b2-b243-4cff-969d-c369217dc9b5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:59 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd Sep 02 00:56:59 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:59 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:56:59 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd Sep 02 00:56:59 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:56:59 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c59f8516-dd96-4c6b-90b6-1a36b70e72bd" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-quobyte-c59f8516-dd96-4c6b-90b6-1a36b70e72bd" released by "delete_volume" :: held 0.626s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:56:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Created reservations ['9e0c065d-26f8-470e-aa4f-4aee1edaa0fd', '1d60edcf-abb1-4ef7-a999-de8d9cad28cd', 'a48ba40d-d377-4108-bfc9-391275033b46', '48e16847-6c11-4f58-950f-37d8c2dcb71b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:00 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:00 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:00 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Deleted volume successfully. Sep 02 00:57:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ab8dfc26-890d-4b7f-9c6a-66a01db35091 tempest-CreateVolumesFromSourceVolumeTest-1234281691 None] Lock "cinder-c59f8516-dd96-4c6b-90b6-1a36b70e72bd-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Flow 'volume_create_manager' (42f09d19-e241-4565-9200-0be32051ad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09d4217-0479-4667-9ac3-17ee2aec3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09d4217-0479-4667-9ac3-17ee2aec3965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594960696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0b566b-38d7-4dc0-9c42-1f51c318bc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8445e0e1344ae290db7943bd7c5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:04Z,use_quota=True,user_id='33a4b506579a47f7806f7855abacd732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aedfe1-5518-414b-b2b5-81e8347fb7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45aedfe1-5518-414b-b2b5-81e8347fb7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01884fd0-4d82-4a5c-af36-e8fea8b2ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01884fd0-4d82-4a5c-af36-e8fea8b2ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0b566b-38d7-4dc0-9c42-1f51c318bc7c', 'volume_name': 'volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037056f2-19e6-4147-9611-3faea48ae5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (037056f2-19e6-4147-9611-3faea48ae5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade9c599-ecb9-4f53-8d82-00c15792ca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Volume 1b0b566b-38d7-4dc0-9c42-1f51c318bc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c', 'volume_size': 1} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594960696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0b566b-38d7-4dc0-9c42-1f51c318bc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8445e0e1344ae290db7943bd7c5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:04Z,use_quota=True,user_id='33a4b506579a47f7806f7855abacd732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Creating volume 1b0b566b-38d7-4dc0-9c42-1f51c318bc7c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:03 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:03 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c 1073741824 Sep 02 00:57:03 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:04 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c 1073741824" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:04 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c Sep 02 00:57:04 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:04 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c" returned: 0 in 0.235s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] <== create_volume: return (647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.650s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade9c599-ecb9-4f53-8d82-00c15792ca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1eb1cb4-2f32-4e35-9bdb-538cc9e4a38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Volume volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c (1b0b566b-38d7-4dc0-9c42-1f51c318bc7c): created successfully Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1eb1cb4-2f32-4e35-9bdb-538cc9e4a38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Flow 'volume_create_manager' (42f09d19-e241-4565-9200-0be32051ad9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ddc5c095-c46d-45c5-8e15-4d77fdadb0b4 tempest-ProjectReaderTests-854580464 None] Created volume successfully. Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Acquiring lock "cinder-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Lock "cinder-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Acquiring lock "cinder-quobyte-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Lock "cinder-quobyte-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca608a-2857-4670-b7b8-58e658c0137b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:04 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c Sep 02 00:57:04 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:05 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:05 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c Sep 02 00:57:05 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:05 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Lock "cinder-quobyte-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c" released by "delete_volume" :: held 0.628s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Created reservations ['80c2ac84-81a1-468b-bf2a-9990d9daeb46', '0f5b31d4-1e8b-4342-a1fc-945327fdcabe', 'c0167f5f-cd20-4143-8d6e-7887f092061c', '8fd74a2f-0928-4be0-b286-31f4caa26201'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:05 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:05 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:05 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.236s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Deleted volume successfully. Sep 02 00:57:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c74daef7-b191-4090-8603-b6792c86026f tempest-ProjectReaderTests-854580464 None] Lock "cinder-1b0b566b-38d7-4dc0-9c42-1f51c318bc7c-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Flow 'volume_create_manager' (fe305252-71f7-4688-8753-ee07184c4c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef63b5e-2775-4b10-96dd-66db5d1bba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef63b5e-2775-4b10-96dd-66db5d1bba39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821237484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c7e500-0242-404b-9a88-3493ef70f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8445e0e1344ae290db7943bd7c5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:06Z,use_quota=True,user_id='33a4b506579a47f7806f7855abacd732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98b45f5-65a4-4b4e-b85b-bc37e1c58399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98b45f5-65a4-4b4e-b85b-bc37e1c58399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3080930-cad0-4fdc-ada9-664474f5caf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3080930-cad0-4fdc-ada9-664474f5caf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c7e500-0242-404b-9a88-3493ef70f00e', 'volume_name': 'volume-c2c7e500-0242-404b-9a88-3493ef70f00e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6179a76-4dec-4c91-a864-27b010054008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6179a76-4dec-4c91-a864-27b010054008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3f94c9-8d41-426c-ae1e-78f5f462dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Volume c2c7e500-0242-404b-9a88-3493ef70f00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c7e500-0242-404b-9a88-3493ef70f00e', 'volume_size': 1} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821237484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c7e500-0242-404b-9a88-3493ef70f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8445e0e1344ae290db7943bd7c5782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:06Z,use_quota=True,user_id='33a4b506579a47f7806f7855abacd732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Creating volume c2c7e500-0242-404b-9a88-3493ef70f00e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:06 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:06 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e 1073741824 Sep 02 00:57:06 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:06 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e 1073741824" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:06 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e Sep 02 00:57:06 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:07 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e" returned: 0 in 0.242s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3f94c9-8d41-426c-ae1e-78f5f462dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c7e500-0242-404b-9a88-3493ef70f00e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9179ba0-83c1-4793-a9d5-9f44cb1613db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:07 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Volume volume-c2c7e500-0242-404b-9a88-3493ef70f00e (c2c7e500-0242-404b-9a88-3493ef70f00e): created successfully Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9179ba0-83c1-4793-a9d5-9f44cb1613db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Flow 'volume_create_manager' (fe305252-71f7-4688-8753-ee07184c4c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b8ead189-2aa2-48fa-8578-2bd827bacbed tempest-ProjectReaderTests-854580464 None] Created volume successfully. Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Acquiring lock "cinder-c2c7e500-0242-404b-9a88-3493ef70f00e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Lock "cinder-c2c7e500-0242-404b-9a88-3493ef70f00e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Acquiring lock "cinder-quobyte-c2c7e500-0242-404b-9a88-3493ef70f00e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Lock "cinder-quobyte-c2c7e500-0242-404b-9a88-3493ef70f00e" acquired by "delete_volume" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f75ddc-9dbf-479d-8b2c-14384a7cd6a0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:07 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e Sep 02 00:57:07 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:07 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:07 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e Sep 02 00:57:07 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:08 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c2c7e500-0242-404b-9a88-3493ef70f00e" returned: 0 in 0.234s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Lock "cinder-quobyte-c2c7e500-0242-404b-9a88-3493ef70f00e" released by "delete_volume" :: held 0.610s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Created reservations ['7e2f995a-a8fe-47e8-8b83-00a6c14f9b74', '093380ec-2c61-4002-b402-f630c83f603a', '7b8d3175-518e-4f81-a4ce-cab41b785cbd', '4ed31e16-a18b-422f-bb57-24e6424f2640'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:08 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:08 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:08 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.233s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Deleted volume successfully. Sep 02 00:57:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf95a83e-ecd6-4b71-985c-c9469db10cbe tempest-ProjectReaderTests-854580464 None] Lock "cinder-c2c7e500-0242-404b-9a88-3493ef70f00e-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:12 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:12 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:12 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:57:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:57:18 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=53,cinder:UPDATE=93,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:57:18 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=59,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=13 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (77110cc6-2761-4df6-ab6b-f8de26984aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adac58a8-877c-4e96-9315-31ed5ade8507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adac58a8-877c-4e96-9315-31ed5ade8507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706305562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7eac13a-8320-401e-8aae-3c99ca14839e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:20Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f5de60-b376-44ce-b227-5680face9337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f5de60-b376-44ce-b227-5680face9337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a01c5ad-b9d8-4a26-bd53-e81292c75edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a01c5ad-b9d8-4a26-bd53-e81292c75edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7eac13a-8320-401e-8aae-3c99ca14839e', 'volume_name': 'volume-f7eac13a-8320-401e-8aae-3c99ca14839e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed3ad96-8cd8-471b-8a40-775dc3e437b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed3ad96-8cd8-471b-8a40-775dc3e437b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b2d6e8-99c5-4c2f-821c-a356e9703c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume f7eac13a-8320-401e-8aae-3c99ca14839e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7eac13a-8320-401e-8aae-3c99ca14839e', 'volume_size': 1} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-706305562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7eac13a-8320-401e-8aae-3c99ca14839e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:20Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Creating volume f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:20 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:20 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e 1073741824 Sep 02 00:57:20 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Flow 'volume_create_manager' (667a2a36-9008-41a9-8740-e6c743644586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a4eb4-22f4-47a4-a4be-47b53b75b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293a4eb4-22f4-47a4-a4be-47b53b75b041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d654b8d-da5b-49b7-ba80-4d80304da78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd49adc155c4aa694075561d12a6ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:21Z,use_quota=True,user_id='f643a703560c41c7a02c0aca7e1f7d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782e0cc6-441e-455f-a010-024232fa3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782e0cc6-441e-455f-a010-024232fa3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ab56eb-5777-434d-8eef-a1475c3f5ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ab56eb-5777-434d-8eef-a1475c3f5ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d654b8d-da5b-49b7-ba80-4d80304da78f', 'volume_name': 'volume-9d654b8d-da5b-49b7-ba80-4d80304da78f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac07991-9fff-47e5-ad34-e757231fad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac07991-9fff-47e5-ad34-e757231fad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbbee0e-5aba-4a13-8078-41640259c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:20 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Volume 9d654b8d-da5b-49b7-ba80-4d80304da78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d654b8d-da5b-49b7-ba80-4d80304da78f', 'volume_size': 1} Sep 02 00:57:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:21 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e 1073741824" returned: 0 in 0.536s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:21 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e Sep 02 00:57:21 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (7e93dc3f-ab29-4b9f-9a2b-e9da243d4606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2202cd6-208e-4371-a906-4c6d6a3a15b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2202cd6-208e-4371-a906-4c6d6a3a15b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018549459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c016b932-dcb7-404f-bb8d-f5b1aba87d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:21Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81789daf-30a2-44be-948c-377dbe013e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81789daf-30a2-44be-948c-377dbe013e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db4cade-a4d9-4083-9754-753d2b74ab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db4cade-a4d9-4083-9754-753d2b74ab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c016b932-dcb7-404f-bb8d-f5b1aba87d5a', 'volume_name': 'volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ab31ff-06ff-4419-b7a1-8e26e964b475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ab31ff-06ff-4419-b7a1-8e26e964b475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8560a3-09c6-4cda-8637-8b70a40a17cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Volume c016b932-dcb7-404f-bb8d-f5b1aba87d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a', 'volume_size': 1} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:21 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d654b8d-da5b-49b7-ba80-4d80304da78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd49adc155c4aa694075561d12a6ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:21Z,use_quota=True,user_id='f643a703560c41c7a02c0aca7e1f7d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Creating volume 9d654b8d-da5b-49b7-ba80-4d80304da78f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:21 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:21 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f 1073741824 Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b2d6e8-99c5-4c2f-821c-a356e9703c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7eac13a-8320-401e-8aae-3c99ca14839e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db326351-f8c1-49d5-8889-2f5f90ba80a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume volume-f7eac13a-8320-401e-8aae-3c99ca14839e (f7eac13a-8320-401e-8aae-3c99ca14839e): created successfully Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db326351-f8c1-49d5-8889-2f5f90ba80a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (77110cc6-2761-4df6-ab6b-f8de26984aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7c414244-71c5-463d-8f0d-4e7d36fc6a78 tempest-CreateVolumesFromSnapshotTest-270619486 None] Created volume successfully. Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (d3b48b6e-c815-43a7-9851-74511a36ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8004803c-6a54-4f69-a838-f4ecdfbe0bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8004803c-6a54-4f69-a838-f4ecdfbe0bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882859415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf81b8e3-ebc6-446e-93e7-805706ad25fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:22Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc2e0b7-c540-4a53-b10b-e9baac1a10cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc2e0b7-c540-4a53-b10b-e9baac1a10cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcf5197-9215-46a0-bc7f-8cf041ec17a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcf5197-9215-46a0-bc7f-8cf041ec17a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf81b8e3-ebc6-446e-93e7-805706ad25fc', 'volume_name': 'volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45864a70-838d-4289-896f-6395476a7461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45864a70-838d-4289-896f-6395476a7461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7802fc0-4de4-4f12-8f08-6e7cc265ce46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Volume cf81b8e3-ebc6-446e-93e7-805706ad25fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc', 'volume_size': 1} Sep 02 00:57:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (c2039f53-3a25-498a-b9cd-46e6940425c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:22 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b19d91-0115-447d-a566-943235cdee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f 1073741824" returned: 0 in 0.611s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b19d91-0115-447d-a566-943235cdee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368199184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1433f88-e21b-45e4-bd0f-0d280bbd802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:22Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663634a-80a8-45f3-bd20-35c050aadde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663634a-80a8-45f3-bd20-35c050aadde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8906a437-fc0a-4ac8-b0b2-09b6a5c1120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8906a437-fc0a-4ac8-b0b2-09b6a5c1120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1433f88-e21b-45e4-bd0f-0d280bbd802d', 'volume_name': 'volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3696677f-3439-48be-9681-5bea394ff63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3696677f-3439-48be-9681-5bea394ff63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467ab804-5855-4efc-8dec-20041d4ec8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Volume b1433f88-e21b-45e4-bd0f-0d280bbd802d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d', 'volume_size': 1} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:22 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f Sep 02 00:57:22 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:22 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f" returned: 0 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018549459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c016b932-dcb7-404f-bb8d-f5b1aba87d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:21Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Creating volume c016b932-dcb7-404f-bb8d-f5b1aba87d5a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:22 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:22 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a 1073741824 Sep 02 00:57:22 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbbee0e-5aba-4a13-8078-41640259c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d654b8d-da5b-49b7-ba80-4d80304da78f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed101cf-1423-4431-9a75-aed9b1fafd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Volume volume-9d654b8d-da5b-49b7-ba80-4d80304da78f (9d654b8d-da5b-49b7-ba80-4d80304da78f): created successfully Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed101cf-1423-4431-9a75-aed9b1fafd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Flow 'volume_create_manager' (667a2a36-9008-41a9-8740-e6c743644586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-802588a1-58cf-44d1-b4e5-d057b61670c2 tempest-CinderUnicodeTest-1496712242 None] Created volume successfully. Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (7a4a5a53-681d-4454-8883-5eaa0385fc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e9633a-4267-469a-9975-a69e6deea758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e9633a-4267-469a-9975-a69e6deea758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957227439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7029d20c-d259-40dd-b58a-8011383b725a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:23Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab40c10-fbf6-4574-81e3-72574515853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab40c10-fbf6-4574-81e3-72574515853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee666559-da4b-471f-9a85-c244a1d8065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee666559-da4b-471f-9a85-c244a1d8065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7029d20c-d259-40dd-b58a-8011383b725a', 'volume_name': 'volume-7029d20c-d259-40dd-b58a-8011383b725a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02695487-34ce-4c8b-8fcf-e1c0b7bff57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02695487-34ce-4c8b-8fcf-e1c0b7bff57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecca0b4-c367-44ad-915a-8d21750413fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Volume 7029d20c-d259-40dd-b58a-8011383b725a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7029d20c-d259-40dd-b58a-8011383b725a', 'volume_size': 1} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:23 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a 1073741824" returned: 0 in 0.585s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (c6f3219a-31a6-4c4f-b234-a9907aaa5177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bf9e2c-a67f-4b85-8165-d0dbead74559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67bf9e2c-a67f-4b85-8165-d0dbead74559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760213364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50399d8b-6bfa-4e3a-9a59-5a2f402cf738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:23Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65499aff-be47-48a7-90de-65d09ee61dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65499aff-be47-48a7-90de-65d09ee61dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc670b2-336d-49d4-8e1c-e1e2287b2145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc670b2-336d-49d4-8e1c-e1e2287b2145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50399d8b-6bfa-4e3a-9a59-5a2f402cf738', 'volume_name': 'volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f4a01b-5fb4-4f7f-a9ad-b27f425e880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f4a01b-5fb4-4f7f-a9ad-b27f425e880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fb6495-c609-4a41-823b-53b45babcfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Volume 50399d8b-6bfa-4e3a-9a59-5a2f402cf738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738', 'volume_size': 1} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:23 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a Sep 02 00:57:23 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:23 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.731s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882859415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf81b8e3-ebc6-446e-93e7-805706ad25fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:22Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Creating volume cf81b8e3-ebc6-446e-93e7-805706ad25fc {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:23 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc 1073741824 Sep 02 00:57:23 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8560a3-09c6-4cda-8637-8b70a40a17cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21adac6d-30f2-4eff-b13d-5e630e08f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Volume volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a (c016b932-dcb7-404f-bb8d-f5b1aba87d5a): created successfully Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21adac6d-30f2-4eff-b13d-5e630e08f369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (7e93dc3f-ab29-4b9f-9a2b-e9da243d4606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4cf7c6a2-3eb4-42c9-8ac1-3dc1980675e6 tempest-CreateVolumesFromImageTest-120161214 None] Created volume successfully. Sep 02 00:57:24 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc 1073741824" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:24 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc Sep 02 00:57:24 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Flow 'volume_create_manager' (4ba26f2d-1eda-494d-86dc-8c6118cafa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c7516c-9c36-4edb-84cc-9ad91da65d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c7516c-9c36-4edb-84cc-9ad91da65d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-518155597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571a01cb-e3e6-4bcd-a49b-1c98cf3bf439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd49adc155c4aa694075561d12a6ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:24Z,use_quota=True,user_id='f643a703560c41c7a02c0aca7e1f7d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cff85c3-1bb1-40a8-ac08-2f7edd471364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cff85c3-1bb1-40a8-ac08-2f7edd471364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21023188-f441-43f3-baad-be6b068c2fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21023188-f441-43f3-baad-be6b068c2fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571a01cb-e3e6-4bcd-a49b-1c98cf3bf439', 'volume_name': 'volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848ed6f7-da55-4d2d-ac2f-955f55d79aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848ed6f7-da55-4d2d-ac2f-955f55d79aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbd2fb7-0474-4dee-9925-9163b63061e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Volume 571a01cb-e3e6-4bcd-a49b-1c98cf3bf439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439', 'volume_size': 1} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:24 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-368199184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1433f88-e21b-45e4-bd0f-0d280bbd802d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:22Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Creating volume b1433f88-e21b-45e4-bd0f-0d280bbd802d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:24 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:24 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d 1073741824 Sep 02 00:57:24 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7802fc0-4de4-4f12-8f08-6e7cc265ce46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d53ca1-9130-461e-858d-c1fd97cb0c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Volume volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc (cf81b8e3-ebc6-446e-93e7-805706ad25fc): created successfully Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d53ca1-9130-461e-858d-c1fd97cb0c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (d3b48b6e-c815-43a7-9851-74511a36ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-770387f5-3bfd-4daa-ace2-00147b3a5544 tempest-CreateVolumesFromImageTest-120161214 None] Created volume successfully. Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Flow 'volume_create_manager' (4f5d8575-2ed8-4747-adaa-afc0d8b4edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273c3f66-83f7-46e3-8c48-7a3bc9a182d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273c3f66-83f7-46e3-8c48-7a3bc9a182d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb4bcf5-7802-462f-a72c-6f34a39b7f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0006b4f4dce45b092105e6ba5ef52d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:25Z,use_quota=True,user_id='09078d2b9b6c4e218afb264f25d740ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b404442c-3bc8-45de-b4fa-9c8fbcf46877),volume_type_id=b404442c-3bc8-45de-b4fa-9c8fbcf46877)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f34ae10-dbc2-4d8c-99f4-9d597f25fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f34ae10-dbc2-4d8c-99f4-9d597f25fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e53a74-6517-484d-86cb-82e09a6bb405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:24 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:57:25 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e53a74-6517-484d-86cb-82e09a6bb405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fb4bcf5-7802-462f-a72c-6f34a39b7f05', 'volume_name': 'volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05', 'volume_size': 1, 'image_id': 'f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6e2c41598249fc4dd33e0f69bdcf8c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0006b4f4dce45b092105e6ba5ef52d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f6b89f0e7ad0b4ede5676600912b95039aa74feeb990efb93e86dfb832683d11441f74ffe229de85368a09658560c56e0b2a9b22111f8f824a57aa5a9a8b127', 'id': 'f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'created_at': datetime.datetime(2026, 9, 1, 22, 57, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 57, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2e4086-8046-4408-b6b8-586c60ab55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2e4086-8046-4408-b6b8-586c60ab55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c250b7-3574-433d-af89-3445bc628091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Volume 3fb4bcf5-7802-462f-a72c-6f34a39b7f05: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05', 'volume_size': 1, 'image_id': 'f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6e2c41598249fc4dd33e0f69bdcf8c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0006b4f4dce45b092105e6ba5ef52d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f6b89f0e7ad0b4ede5676600912b95039aa74feeb990efb93e86dfb832683d11441f74ffe229de85368a09658560c56e0b2a9b22111f8f824a57aa5a9a8b127', 'id': 'f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'created_at': datetime.datetime(2026, 9, 1, 22, 57, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 57, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Trying to clone 3fb4bcf5-7802-462f-a72c-6f34a39b7f05 from image f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d 1073741824" returned: 0 in 0.496s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:25 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d Sep 02 00:57:25 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:57:25 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9e201-06eb-4214-a403-e90ba568e683]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:25 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD Sep 02 00:57:25 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:25 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d" returned: 0 in 0.327s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.500s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Creating offline snapshot 0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f of volume f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467ab804-5855-4efc-8dec-20041d4ec8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ae725e-2c05-4546-bdd6-bac700085cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a135c0-1a04-4bef-b28c-a8ad7e896e63]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Volume volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d (b1433f88-e21b-45e4-bd0f-0d280bbd802d): created successfully Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ae725e-2c05-4546-bdd6-bac700085cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (c2039f53-3a25-498a-b9cd-46e6940425c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ab2cbc70-759b-403e-9981-24371383d008 tempest-CreateVolumesFromImageTest-120161214 None] Created volume successfully. Sep 02 00:57:25 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e Sep 02 00:57:25 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:25 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:25 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD Sep 02 00:57:25 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:25 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:25 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f 1G Sep 02 00:57:25 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:26 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Temporary image f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 is fetched for user 09078d2b9b6c4e218afb264f25d740ed. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[880cf3b2-ff2f-4c18-a672-a64305bd8cd6]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:26 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD Sep 02 00:57:26 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:26 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f 1G" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7eac13a-8320-401e-8aae-3c99ca14839e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:26 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7eac13a-8320-401e-8aae-3c99ca14839e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f Sep 02 00:57:26 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:26 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:26 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD Sep 02 00:57:26 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:26 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7eac13a-8320-401e-8aae-3c99ca14839e -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:26 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f is being set with open permissions: ugo+rw Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:26 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f Sep 02 00:57:26 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:26 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:26 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" returned: 0 in 0.278s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:27 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.info Sep 02 00:57:27 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:27 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.info" returned: 0 in 0.250s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:27 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.info is being set with open permissions: ugo+rw Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:27 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.info Sep 02 00:57:27 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:27 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.info" returned: 0 in 0.244s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.330s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957227439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7029d20c-d259-40dd-b58a-8011383b725a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:23Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Creating volume 7029d20c-d259-40dd-b58a-8011383b725a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:27 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:27 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a 1073741824 Sep 02 00:57:27 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f4ab01d8-798f-4521-9d95-e7db08a01368 tempest-CreateVolumesFromSnapshotTest-270619486 None] Create snapshot completed successfully Sep 02 00:57:27 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a 1073741824" returned: 0 in 0.445s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:27 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a Sep 02 00:57:27 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:28 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.840s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760213364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50399d8b-6bfa-4e3a-9a59-5a2f402cf738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7c026145464616a28d87b6613900da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:23Z,use_quota=True,user_id='b033c28c711142259694be7cdda4c67b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Creating volume 50399d8b-6bfa-4e3a-9a59-5a2f402cf738 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:28 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:28 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 1073741824 Sep 02 00:57:28 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecca0b4-c367-44ad-915a-8d21750413fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7029d20c-d259-40dd-b58a-8011383b725a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc51918-8455-4922-95f8-eb5bfcbb61ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Volume volume-7029d20c-d259-40dd-b58a-8011383b725a (7029d20c-d259-40dd-b58a-8011383b725a): created successfully Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc51918-8455-4922-95f8-eb5bfcbb61ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (7a4a5a53-681d-4454-8883-5eaa0385fc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8eaede04-1268-47ad-93e1-44378cbd0b57 tempest-CreateVolumesFromImageTest-120161214 None] Created volume successfully. Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (78e7809e-aa6a-4a40-944d-53aeab723c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e786991e-2627-4761-9356-58aaba8b3bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e786991e-2627-4761-9356-58aaba8b3bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692939310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7aa26e-c8de-47fc-916a-389996f83538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:28Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c6bba8-c0af-4664-b7a7-c460a18d9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c6bba8-c0af-4664-b7a7-c460a18d9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d0d61e-befa-4b16-a9f8-d6bf7ede6784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d0d61e-befa-4b16-a9f8-d6bf7ede6784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7aa26e-c8de-47fc-916a-389996f83538', 'volume_name': 'volume-cc7aa26e-c8de-47fc-916a-389996f83538', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96195abc-5a05-4550-9193-bdb0c9fd6876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96195abc-5a05-4550-9193-bdb0c9fd6876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b3ad37-b5c2-4a31-adff-d9f66460f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume cc7aa26e-c8de-47fc-916a-389996f83538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7aa26e-c8de-47fc-916a-389996f83538', 'volume_size': 1} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:28 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 1073741824" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:28 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 Sep 02 00:57:28 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (203fdcbc-3b6e-4445-a801-b6447ebf4467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d432a90-6631-4ec7-b8cb-7c374541d086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d432a90-6631-4ec7-b8cb-7c374541d086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024316170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b635a7-d380-450f-92ab-2c5594a6e691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:29Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858f6e54-3b72-479a-9ea8-04064fbe92e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858f6e54-3b72-479a-9ea8-04064fbe92e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef714bf5-f7d2-4e00-8b58-e576fd58d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef714bf5-f7d2-4e00-8b58-e576fd58d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b635a7-d380-450f-92ab-2c5594a6e691', 'volume_name': 'volume-f1b635a7-d380-450f-92ab-2c5594a6e691', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c091495f-be25-47d1-acf6-9292b30ec43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c091495f-be25-47d1-acf6-9292b30ec43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b51b53-1230-4132-b31a-e9e68d8c34d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume f1b635a7-d380-450f-92ab-2c5594a6e691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b635a7-d380-450f-92ab-2c5594a6e691', 'volume_size': 1} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:29 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738" returned: 0 in 0.273s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.592s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-518155597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571a01cb-e3e6-4bcd-a49b-1c98cf3bf439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd49adc155c4aa694075561d12a6ddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:24Z,use_quota=True,user_id='f643a703560c41c7a02c0aca7e1f7d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Creating volume 571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:29 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fb6495-c609-4a41-823b-53b45babcfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcf1511-5f62-4e3a-abda-176157b61833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 1073741824 Sep 02 00:57:29 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Volume volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 (50399d8b-6bfa-4e3a-9a59-5a2f402cf738): created successfully Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcf1511-5f62-4e3a-abda-176157b61833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Flow 'volume_create_manager' (c6f3219a-31a6-4c4f-b234-a9907aaa5177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7ef79ab3-d55a-4204-a4b5-c298ab272382 tempest-CreateVolumesFromImageTest-120161214 None] Created volume successfully. Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (468589c3-6cd3-4c72-861d-78a4938093fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccaddca-75f7-4af3-891b-09877c205ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccaddca-75f7-4af3-891b-09877c205ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1126751031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb083f0-41cc-4979-8902-ceb26367dbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:29Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce5d6bd-9cd7-4dee-bec0-f8e808cc573b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce5d6bd-9cd7-4dee-bec0-f8e808cc573b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6777f6-1793-496c-8c30-bf2678e60906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6777f6-1793-496c-8c30-bf2678e60906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb083f0-41cc-4979-8902-ceb26367dbcf', 'volume_name': 'volume-3bb083f0-41cc-4979-8902-ceb26367dbcf', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b97f5-da90-41da-a062-1710560b45e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b97f5-da90-41da-a062-1710560b45e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5612112e-3ae7-42df-a4f3-c35013342ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume 3bb083f0-41cc-4979-8902-ceb26367dbcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb083f0-41cc-4979-8902-ceb26367dbcf', 'volume_size': 1} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:29 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 1073741824" returned: 0 in 0.547s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:29 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 Sep 02 00:57:29 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (87965561-5eac-4220-9808-e74a2e07fd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eba1cb-346f-42b0-9655-4d7557e345d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6eba1cb-346f-42b0-9655-4d7557e345d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236110985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23eda769-a49b-4a9e-a93d-2c2a1d55c05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:30Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3af620-3134-48dd-8d11-f6639fa2f7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3af620-3134-48dd-8d11-f6639fa2f7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bf9060-d749-4fa9-afb1-d4b6a8338777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bf9060-d749-4fa9-afb1-d4b6a8338777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23eda769-a49b-4a9e-a93d-2c2a1d55c05d', 'volume_name': 'volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26a1f9e-2878-431b-85cc-5ef32b6f46aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26a1f9e-2878-431b-85cc-5ef32b6f46aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381acfcd-cb85-47dc-b92e-bb6041d0967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume 23eda769-a49b-4a9e-a93d-2c2a1d55c05d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d', 'volume_size': 1} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-50399d8b-6bfa-4e3a-9a59-5a2f402cf738-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:30 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-50399d8b-6bfa-4e3a-9a59-5a2f402cf738-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.213s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb4bcf5-7802-462f-a72c-6f34a39b7f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0006b4f4dce45b092105e6ba5ef52d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:25Z,use_quota=True,user_id='09078d2b9b6c4e218afb264f25d740ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b404442c-3bc8-45de-b4fa-9c8fbcf46877),volume_type_id=b404442c-3bc8-45de-b4fa-9c8fbcf46877)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Creating volume 3fb4bcf5-7802-462f-a72c-6f34a39b7f05 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbd2fb7-0474-4dee-9925-9163b63061e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:30 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 1073741824 Sep 02 00:57:30 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41a9b7e-9ec7-40ae-968c-ff78d8ce8688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Volume volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 (571a01cb-e3e6-4bcd-a49b-1c98cf3bf439): created successfully Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41a9b7e-9ec7-40ae-968c-ff78d8ce8688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Flow 'volume_create_manager' (4ba26f2d-1eda-494d-86dc-8c6118cafa36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-quobyte-50399d8b-6bfa-4e3a-9a59-5a2f402cf738" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d8ca4ca7-1604-458f-8b85-231b1ea0532b tempest-CinderUnicodeTest-1496712242 None] Created volume successfully. Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (246a76de-f819-4c24-b677-1f42c0f76583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beac4d5-add2-4884-8ed1-1c362289c5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1beac4d5-add2-4884-8ed1-1c362289c5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1816155092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc532091-257b-4e85-a8f6-36c1555a8a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:30Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ce002c-b4af-4d37-8eb5-a029536f6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ce002c-b4af-4d37-8eb5-a029536f6be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee57aa3-980a-449e-814e-4a4ebcb9f3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee57aa3-980a-449e-814e-4a4ebcb9f3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc532091-257b-4e85-a8f6-36c1555a8a69', 'volume_name': 'volume-dc532091-257b-4e85-a8f6-36c1555a8a69', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fe0d23-0106-49a6-a3e1-2717c61d05e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fe0d23-0106-49a6-a3e1-2717c61d05e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2f8002-99b1-4535-9453-84eec685d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume dc532091-257b-4e85-a8f6-36c1555a8a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc532091-257b-4e85-a8f6-36c1555a8a69', 'volume_size': 1} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-50399d8b-6bfa-4e3a-9a59-5a2f402cf738" acquired by "delete_volume" :: waited 0.098s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9bd386-98bf-4bff-9e55-1bcff8bbc030]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:30 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 Sep 02 00:57:30 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:30 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 1073741824" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:30 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 Sep 02 00:57:30 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:30 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738" returned: 0 in 0.421s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:30 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738 Sep 02 00:57:30 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:30 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.252s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692939310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7aa26e-c8de-47fc-916a-389996f83538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:28Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Creating volume cc7aa26e-c8de-47fc-916a-389996f83538 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:30 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 1073741824 Sep 02 00:57:30 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Attempting download of f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'metadata': {}}])) to volume 3fb4bcf5-7802-462f-a72c-6f34a39b7f05. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:57:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:30 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-50399d8b-6bfa-4e3a-9a59-5a2f402cf738" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[79275fc6-955a-4728-9680-ad29689f8b63]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_965nkhfm {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-50399d8b-6bfa-4e3a-9a59-5a2f402cf738" released by "delete_volume" :: held 0.779s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Created reservations ['b9ede973-e193-4947-bacc-fad9d8e9e1ff', 'cdb335c8-c100-4404-a884-317706e456a9', '5da4a902-db76-45ef-b9c6-51d95d76a0d7', '3b9d844a-cc3c-4b6d-9a88-5270a4e709d1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:31 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_965nkhfm Sep 02 00:57:31 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:31 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:31 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:31 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 1073741824" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:31 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_965nkhfm" returned: 0 in 0.415s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_965nkhfm {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:31 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 Sep 02 00:57:31 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:31 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.283s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Deleted volume successfully. Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf859a05-9c8d-4637-879b-4235e772f145 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-50399d8b-6bfa-4e3a-9a59-5a2f402cf738-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:31 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_965nkhfm Sep 02 00:57:31 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:31 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.686s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024316170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b635a7-d380-450f-92ab-2c5594a6e691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:29Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Creating volume f1b635a7-d380-450f-92ab-2c5594a6e691 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b3ad37-b5c2-4a31-adff-d9f66460f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7aa26e-c8de-47fc-916a-389996f83538', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:31 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 1073741824 Sep 02 00:57:31 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd87bfaf-fb5d-4997-a1f1-0100f8bb9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume volume-cc7aa26e-c8de-47fc-916a-389996f83538 (cc7aa26e-c8de-47fc-916a-389996f83538): created successfully Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd87bfaf-fb5d-4997-a1f1-0100f8bb9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (78e7809e-aa6a-4a40-944d-53aeab723c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:31 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_965nkhfm" returned: 1 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_965nkhfm' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea55f215-ab0e-40d4-9144-6805038fdb8e]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2b33ae7b-d9f7-4355-8d41-a0730be01a0e tempest-CreateVolumesFromSnapshotTest-270619486 None] Created volume successfully. Sep 02 00:57:31 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD Sep 02 00:57:31 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:32 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:32 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 1073741824" returned: 0 in 0.536s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-7029d20c-d259-40dd-b58a-8011383b725a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:32 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:32 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-7029d20c-d259-40dd-b58a-8011383b725a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:32 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 Sep 02 00:57:32 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-quobyte-7029d20c-d259-40dd-b58a-8011383b725a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-7029d20c-d259-40dd-b58a-8011383b725a" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[256d9f29-6e1e-4ed8-9c2e-ceac947aadcd]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:32 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:57:32 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a Sep 02 00:57:32 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:32 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 Sep 02 00:57:32 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:32 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.216s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1126751031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb083f0-41cc-4979-8902-ceb26367dbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:29Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Creating volume 3bb083f0-41cc-4979-8902-ceb26367dbcf {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:32 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:32 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf 1073741824 Sep 02 00:57:32 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b51b53-1230-4132-b31a-e9e68d8c34d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b635a7-d380-450f-92ab-2c5594a6e691', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d800992-39c6-4b62-8a5f-1325a36fe147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume volume-f1b635a7-d380-450f-92ab-2c5594a6e691 (f1b635a7-d380-450f-92ab-2c5594a6e691): created successfully Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d800992-39c6-4b62-8a5f-1325a36fe147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (203fdcbc-3b6e-4445-a801-b6447ebf4467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a3a0258f-5bd7-41b3-b753-f6cf801cae3e tempest-CreateVolumesFromSnapshotTest-270619486 None] Created volume successfully. Sep 02 00:57:32 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a" returned: 0 in 0.414s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:32 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a Sep 02 00:57:32 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:33 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05" returned: 0 in 0.512s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7c01e25-3ad3-4a99-b917-c33b1e1dfab8_2_y9ixokdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:57:33 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:33 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf 1073741824" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:33 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 1G Sep 02 00:57:33 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:33 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7029d20c-d259-40dd-b58a-8011383b725a" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-7029d20c-d259-40dd-b58a-8011383b725a" released by "delete_volume" :: held 0.728s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:33 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf Sep 02 00:57:33 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Created reservations ['2110c6ee-5d05-47bd-8fc6-3de8175749e3', '442dcb0a-cfc5-444a-b1bd-f4168bf5adc2', 'e8c9f65b-e52e-4a9a-91ce-719f120dd4e3', 'e89b634d-fd2d-42f7-b6fe-935d98cef605'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:33 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:33 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:33 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-b1433f88-e21b-45e4-bd0f-0d280bbd802d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:33 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.648s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236110985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23eda769-a49b-4a9e-a93d-2c2a1d55c05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:30Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Creating volume 23eda769-a49b-4a9e-a93d-2c2a1d55c05d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:33 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 1G" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Downloaded image f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'metadata': {}}])) to volume 3fb4bcf5-7802-462f-a72c-6f34a39b7f05 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Temporary image f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 for user 09078d2b9b6c4e218afb264f25d740ed is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Marking volume 3fb4bcf5-7802-462f-a72c-6f34a39b7f05 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-b1433f88-e21b-45e4-bd0f-0d280bbd802d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:33 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d 1073741824 Sep 02 00:57:33 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5612112e-3ae7-42df-a4f3-c35013342ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb083f0-41cc-4979-8902-ceb26367dbcf', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2630e4ca-215a-46ba-8f71-22d369e3ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Copying metadata from image f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 to 3fb4bcf5-7802-462f-a72c-6f34a39b7f05. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Creating volume glance metadata for volume 3fb4bcf5-7802-462f-a72c-6f34a39b7f05 backed by image f7c01e25-3ad3-4a99-b917-c33b1e1dfab8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e6e2c41598249fc4dd33e0f69bdcf8c8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:57:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume volume-3bb083f0-41cc-4979-8902-ceb26367dbcf (3bb083f0-41cc-4979-8902-ceb26367dbcf): created successfully Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2630e4ca-215a-46ba-8f71-22d369e3ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (468589c3-6cd3-4c72-861d-78a4938093fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:33 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-quobyte-b1433f88-e21b-45e4-bd0f-0d280bbd802d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4fa921a4-0696-4ad8-ae47-b49ec0375c7e tempest-CreateVolumesFromSnapshotTest-270619486 None] Created volume successfully. Sep 02 00:57:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Deleted volume successfully. Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-b1433f88-e21b-45e4-bd0f-0d280bbd802d" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a8bf6b54-a231-45ea-896b-0b7b1b62259c tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-7029d20c-d259-40dd-b58a-8011383b725a-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d220e3-f1e0-4340-b49a-1fcf254c561e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c250b7-3574-433d-af89-3445bc628091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05', 'volume_size': 1, 'image_id': 'f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e6e2c41598249fc4dd33e0f69bdcf8c8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f0006b4f4dce45b092105e6ba5ef52d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f6b89f0e7ad0b4ede5676600912b95039aa74feeb990efb93e86dfb832683d11441f74ffe229de85368a09658560c56e0b2a9b22111f8f824a57aa5a9a8b127', 'id': 'f7c01e25-3ad3-4a99-b917-c33b1e1dfab8', 'created_at': datetime.datetime(2026, 9, 1, 22, 57, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 57, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7c01e25-3ad3-4a99-b917-c33b1e1dfab8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f982cf63-408b-4725-94c5-7296df8c37df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Volume volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 (3fb4bcf5-7802-462f-a72c-6f34a39b7f05): created successfully Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f982cf63-408b-4725-94c5-7296df8c37df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Flow 'volume_create_manager' (4f5d8575-2ed8-4747-adaa-afc0d8b4edc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b11c1dfb-f48c-42be-a8ad-a93848767630 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Created volume successfully. Sep 02 00:57:33 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d Sep 02 00:57:33 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:33 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d 1073741824" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:34 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d Sep 02 00:57:34 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:34 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:34 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d Sep 02 00:57:34 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:34 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1816155092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc532091-257b-4e85-a8f6-36c1555a8a69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65e4b683ce3a4850bcb2b8e1c91857b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:30Z,use_quota=True,user_id='4845df73d05b463a94b326215a63de44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Creating volume dc532091-257b-4e85-a8f6-36c1555a8a69 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381acfcd-cb85-47dc-b92e-bb6041d0967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:34 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 1073741824 Sep 02 00:57:34 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0683dab-02da-4a9b-9420-ba729e1d36a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d (23eda769-a49b-4a9e-a93d-2c2a1d55c05d): created successfully Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0683dab-02da-4a9b-9420-ba729e1d36a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (87965561-5eac-4220-9808-e74a2e07fd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-369f06e2-990f-4baf-84c8-5a6d6d980bba tempest-CreateVolumesFromSnapshotTest-270619486 None] Created volume successfully. Sep 02 00:57:34 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b1433f88-e21b-45e4-bd0f-0d280bbd802d" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-b1433f88-e21b-45e4-bd0f-0d280bbd802d" released by "delete_volume" :: held 0.751s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Created reservations ['71f2c7e7-c88a-42d9-8850-d2ca85a4db64', '8ecd13f9-7b1e-4183-9101-0eca91ca3b1b', '7ddb04dc-6033-4cb3-8a88-cb4338b25eb8', 'eb66d295-82dd-4d27-b450-6d3f93eac213'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Acquiring lock "cinder-3fb4bcf5-7802-462f-a72c-6f34a39b7f05-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "cinder-3fb4bcf5-7802-462f-a72c-6f34a39b7f05-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:34 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:34 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-cf81b8e3-ebc6-446e-93e7-805706ad25fc-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Acquiring lock "cinder-quobyte-3fb4bcf5-7802-462f-a72c-6f34a39b7f05" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "cinder-quobyte-3fb4bcf5-7802-462f-a72c-6f34a39b7f05" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-cf81b8e3-ebc6-446e-93e7-805706ad25fc-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5427cac9-bca9-4056-9d55-b3ba17f359a2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-quobyte-cf81b8e3-ebc6-446e-93e7-805706ad25fc" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-cf81b8e3-ebc6-446e-93e7-805706ad25fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c25e23d-00cb-499f-9505-a6042eb76528]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:34 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 1073741824" returned: 0 in 0.625s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:34 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 Sep 02 00:57:34 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:34 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Deleted volume successfully. Sep 02 00:57:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:35 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77541c1c-9c66-40a0-bf0e-4c08734965ec tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-b1433f88-e21b-45e4-bd0f-0d280bbd802d-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:35 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:35 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc Sep 02 00:57:35 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:35 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05" returned: 0 in 0.510s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:35 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.312s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:35 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05 Sep 02 00:57:35 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2f8002-99b1-4535-9453-84eec685d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc532091-257b-4e85-a8f6-36c1555a8a69', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3378c56d-4a14-4a27-bac8-a75342af07d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Creating offline snapshot 735f62d0-40d5-4d05-95bf-8ed18a43e60d of volume 571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:57:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Volume volume-dc532091-257b-4e85-a8f6-36c1555a8a69 (dc532091-257b-4e85-a8f6-36c1555a8a69): created successfully Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3378c56d-4a14-4a27-bac8-a75342af07d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Flow 'volume_create_manager' (246a76de-f819-4c24-b677-1f42c0f76583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a186c2d7-8047-4e01-b154-d731f4e73464]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:35 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d6a42c04-ea3b-4e2d-b696-8781daf735b3 tempest-CreateVolumesFromSnapshotTest-270619486 None] Created volume successfully. Sep 02 00:57:35 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc Sep 02 00:57:35 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:35 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 Sep 02 00:57:35 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:35 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3fb4bcf5-7802-462f-a72c-6f34a39b7f05" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "cinder-quobyte-3fb4bcf5-7802-462f-a72c-6f34a39b7f05" released by "delete_volume" :: held 0.863s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Created reservations ['fbe05307-11e2-4b74-9f61-fbe842264e53', '4393ec7c-8ec3-46c6-b19c-016e412b949c', 'c08fc466-7d9b-49cb-8de5-11d5444ef111', 'cd1ed03b-31c9-4f7d-be94-8be578d1d95e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:35 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cf81b8e3-ebc6-446e-93e7-805706ad25fc" returned: 0 in 0.266s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-cf81b8e3-ebc6-446e-93e7-805706ad25fc" released by "delete_volume" :: held 0.843s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:35 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Created reservations ['a58fccd5-90ef-4fe9-92c8-e84252ab797b', '4ee09365-8c9f-467a-9a04-8e83422c75de', '9d52cd8f-5c4d-4b1e-b055-a2fb4122ac4e', '7c1b2868-a15b-4b8a-901c-577754fed207'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" returned: 0 in 0.435s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:35 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:35 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-dc532091-257b-4e85-a8f6-36c1555a8a69-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:35 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d 1G Sep 02 00:57:35 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-dc532091-257b-4e85-a8f6-36c1555a8a69-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-dc532091-257b-4e85-a8f6-36c1555a8a69" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-dc532091-257b-4e85-a8f6-36c1555a8a69" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a850a8-5be8-4904-b97f-028de107b661]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:36 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:36 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:36 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 Sep 02 00:57:36 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:36 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Deleted volume successfully. Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a6e06fc7-6225-49f9-880e-0ed9bcadf5a9 tempest-VolumeAndVolumeTypeFromImageTest-2130257811 None] Lock "cinder-3fb4bcf5-7802-462f-a72c-6f34a39b7f05-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:36 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Deleted volume successfully. Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-11768d26-d98e-4ee6-9ffe-04bb66df3bf0 tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-cf81b8e3-ebc6-446e-93e7-805706ad25fc-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:36 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d 1G" returned: 0 in 0.630s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:36 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d Sep 02 00:57:36 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:36 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:36 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69 Sep 02 00:57:36 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:36 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:36 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d is being set with open permissions: ugo+rw Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:36 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dc532091-257b-4e85-a8f6-36c1555a8a69" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:36 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d Sep 02 00:57:36 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-dc532091-257b-4e85-a8f6-36c1555a8a69" released by "delete_volume" :: held 0.819s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Created reservations ['82eb9337-876c-4f9c-babd-d76bc882d451', 'ecf6592d-9b53-452d-a200-f576bf96b462', '4ea5f743-2b48-46e3-9ba6-ec7ccbd8e6b6', '783f8f2f-c331-4505-a550-95eebf993071'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:36 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:36 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-c016b932-dcb7-404f-bb8d-f5b1aba87d5a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-c016b932-dcb7-404f-bb8d-f5b1aba87d5a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-23eda769-a49b-4a9e-a93d-2c2a1d55c05d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-23eda769-a49b-4a9e-a93d-2c2a1d55c05d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:37 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "cinder-quobyte-c016b932-dcb7-404f-bb8d-f5b1aba87d5a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-c016b932-dcb7-404f-bb8d-f5b1aba87d5a" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-23eda769-a49b-4a9e-a93d-2c2a1d55c05d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45891b5-7f73-48d7-acd2-19d858b7abae]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:37 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.324s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Deleted volume successfully. Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-23eda769-a49b-4a9e-a93d-2c2a1d55c05d" acquired by "delete_volume" :: waited 0.057s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:37 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.info Sep 02 00:57:37 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e7d77d-f9de-4bfb-8592-3dea892076f0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38227db5-e983-45c7-bb28-6426386ed254 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-dc532091-257b-4e85-a8f6-36c1555a8a69-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:37 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a Sep 02 00:57:37 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:37 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d Sep 02 00:57:37 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:37 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.info" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.info is being set with open permissions: ugo+rw Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:37 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.info Sep 02 00:57:37 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:37 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a" returned: 0 in 0.537s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:37 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a Sep 02 00:57:37 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:37 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d" returned: 0 in 0.489s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:37 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d Sep 02 00:57:37 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:37 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.info" returned: 0 in 0.299s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a52bd2c9-0fe7-4e73-b0bd-d1be0e861fed tempest-CinderUnicodeTest-1496712242 None] Create snapshot completed successfully Sep 02 00:57:38 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c016b932-dcb7-404f-bb8d-f5b1aba87d5a" returned: 0 in 0.311s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-quobyte-c016b932-dcb7-404f-bb8d-f5b1aba87d5a" released by "delete_volume" :: held 0.910s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:38 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-23eda769-a49b-4a9e-a93d-2c2a1d55c05d" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Created reservations ['9f3f2b09-a4b7-4957-9beb-5c0d7c6898fd', 'cf4432b5-7267-422a-9283-446e8ffc6258', 'a6a3e2bb-ebb8-49aa-b7ca-3c03d46c6097', 'a67a4ac6-46ce-4f1e-bf6b-96dd56252900'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-23eda769-a49b-4a9e-a93d-2c2a1d55c05d" released by "delete_volume" :: held 0.892s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Created reservations ['6f99ae9e-e7d4-4fe5-bb18-cc7a846bd4fe', '94814fb3-19b2-4eb8-a18b-766e5f9bc378', 'e21c51cd-1a91-4955-8f4c-2e0f504476d3', '893097df-a4a7-451c-b0c5-28ba302c776e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:38 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:38 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "cinder-735f62d0-40d5-4d05-95bf-8ed18a43e60d-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-735f62d0-40d5-4d05-95bf-8ed18a43e60d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "cinder-quobyte-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "cinder-quobyte-735f62d0-40d5-4d05-95bf-8ed18a43e60d" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-735f62d0-40d5-4d05-95bf-8ed18a43e60d" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Deleting offline snapshot 735f62d0-40d5-4d05-95bf-8ed18a43e60d of volume 571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:57:38 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:38 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] snapshot_file for this snap is: volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:57:38 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaeed36-bfa4-4b27-90c6-2f3deb5dfa13]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Deleted volume successfully. Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-764803e7-226c-4045-a212-3a2c11258ddc tempest-CreateVolumesFromImageTest-120161214 None] Lock "cinder-c016b932-dcb7-404f-bb8d-f5b1aba87d5a-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:38 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d Sep 02 00:57:38 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:38 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.281s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Deleted volume successfully. Sep 02 00:57:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d50c1c95-305f-4ada-a616-7d0ecafbee5b tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-23eda769-a49b-4a9e-a93d-2c2a1d55c05d-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:39 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d" returned: 0 in 0.435s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8642e9-9ebb-4848-ba25-cdde159d20a2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:39 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 Sep 02 00:57:39 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-3bb083f0-41cc-4979-8902-ceb26367dbcf-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-3bb083f0-41cc-4979-8902-ceb26367dbcf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-3bb083f0-41cc-4979-8902-ceb26367dbcf" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:39 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-3bb083f0-41cc-4979-8902-ceb26367dbcf" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1357e7d3-af0f-4b59-9749-1c1b1b415c3a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:39 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d Sep 02 00:57:39 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:39 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf Sep 02 00:57:39 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:40 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:40 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf" returned: 0 in 0.435s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:40 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d Sep 02 00:57:40 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:40 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf Sep 02 00:57:40 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:40 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439.735f62d0-40d5-4d05-95bf-8ed18a43e60d" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:40 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3bb083f0-41cc-4979-8902-ceb26367dbcf" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-735f62d0-40d5-4d05-95bf-8ed18a43e60d" released by "_delete_snapshot" :: held 1.842s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" released by "delete_snapshot" :: held 1.898s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-3bb083f0-41cc-4979-8902-ceb26367dbcf" released by "delete_volume" :: held 0.845s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Created reservations ['81f0cf7e-649f-4ce4-a9f4-da76a7b332ca', '092ab5ea-d86f-4a7b-b15a-cb0347ccf06a', '6b425bb0-ee11-4564-a8a3-a65d803b5689', '72030ee6-57bb-4df0-830e-3178d32179e3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Created reservations ['1a34421d-2f4d-4f29-927d-26de7d99556e', '36b35b6b-d783-472f-89db-924caf623ce6', '063375d9-6ad1-4c18-81bd-56999b84483b', 'a9a42d7f-9c6c-476e-ba8e-7b56b306ccb5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:40 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:40 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Delete snapshot completed successfully. Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-440cf4ca-feaa-4492-a8d9-3fafff0e3852 tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-735f62d0-40d5-4d05-95bf-8ed18a43e60d-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "cinder-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-f1b635a7-d380-450f-92ab-2c5594a6e691-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-f1b635a7-d380-450f-92ab-2c5594a6e691-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "cinder-quobyte-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-f1b635a7-d380-450f-92ab-2c5594a6e691" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b978ee0-53ef-4a00-9625-99171e712b23]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:40 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-f1b635a7-d380-450f-92ab-2c5594a6e691" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Deleted volume successfully. Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe66c5-0ac7-4cab-9909-a67f66f71d0e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5b7931b1-7f8b-4c50-a80a-1d08d34a3ec4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-3bb083f0-41cc-4979-8902-ceb26367dbcf-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:41 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 Sep 02 00:57:41 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:41 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 Sep 02 00:57:41 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:41 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" returned: 0 in 0.488s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:41 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439 Sep 02 00:57:41 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:41 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691" returned: 0 in 0.515s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:41 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691 Sep 02 00:57:41 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:41 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439" released by "delete_volume" :: held 0.864s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Created reservations ['3b56bf86-8d08-496a-b89b-ec73ec503347', 'de51ef1d-e518-4b35-973c-c7129f7c36af', '6934f3fb-9b2a-4de4-86bb-95c7d1f694cf', '9c3cca71-eafb-427b-bdd5-bf656212067c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:41 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f1b635a7-d380-450f-92ab-2c5594a6e691" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-f1b635a7-d380-450f-92ab-2c5594a6e691" released by "delete_volume" :: held 0.966s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:42 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:42 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Created reservations ['0af9c2c6-341b-44fb-b738-ab01daea7f31', '35f7d046-4af1-48c1-80c1-7d14f498373b', '7001f57f-5510-4e07-ba53-a89ab29a140c', 'a45c785f-72cb-48de-a9dd-30eaa8960530'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:42 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:42 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:42 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Deleted volume successfully. Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-14572a23-f378-4268-8704-c3e3f41d3d9e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-571a01cb-e3e6-4bcd-a49b-1c98cf3bf439-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:42 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Deleted volume successfully. Sep 02 00:57:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9742b93f-8375-4cdc-a091-1b1c1ae6d1be tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-f1b635a7-d380-450f-92ab-2c5594a6e691-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "cinder-9d654b8d-da5b-49b7-ba80-4d80304da78f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-cc7aa26e-c8de-47fc-916a-389996f83538-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-cc7aa26e-c8de-47fc-916a-389996f83538-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-9d654b8d-da5b-49b7-ba80-4d80304da78f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-cc7aa26e-c8de-47fc-916a-389996f83538" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "cinder-quobyte-9d654b8d-da5b-49b7-ba80-4d80304da78f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-cc7aa26e-c8de-47fc-916a-389996f83538" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-9d654b8d-da5b-49b7-ba80-4d80304da78f" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a071876e-2d49-4504-bfe0-d70897136456]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5202fe-7406-4b5d-a382-23ee0ca20d50]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:43 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 Sep 02 00:57:43 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:43 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f Sep 02 00:57:43 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:43 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:43 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538 Sep 02 00:57:43 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:43 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f" returned: 0 in 0.460s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:43 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f Sep 02 00:57:43 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:43 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-cc7aa26e-c8de-47fc-916a-389996f83538" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-cc7aa26e-c8de-47fc-916a-389996f83538" released by "delete_volume" :: held 0.781s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:43 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-9d654b8d-da5b-49b7-ba80-4d80304da78f" returned: 0 in 0.299s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-quobyte-9d654b8d-da5b-49b7-ba80-4d80304da78f" released by "delete_volume" :: held 0.813s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Created reservations ['2207cbca-873a-472b-b3da-38044428f5b1', 'a785760c-de74-46c5-80bd-5d93b38f5e3e', 'b0707df7-1162-473f-af2b-84b45ed47149', 'e61f4b2a-ff92-443a-b2b9-9137027000ae'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Created reservations ['210a95b9-3288-4a93-a234-1d446f914090', 'a4953e67-8a19-4f53-bc06-79a764eb4c68', '0c3b190f-a080-4519-a58e-0888836acc3a', 'ccd08fcd-d988-4239-b723-945b5519cced'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:44 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:44 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Flow 'volume_create_manager' (e2cffaa2-aee2-47cc-8931-75a12dcc8fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c141a35-ea6b-4722-bb65-d5f1a83c3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c141a35-ea6b-4722-bb65-d5f1a83c3574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-757570421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6e4654-9dc3-40bb-a610-b2b8481400de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a472b86356444a2faa86bb0c93087929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:44Z,use_quota=True,user_id='816eb65d48a94e85ae23a6959cc2f874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b64e5d-9950-430b-9ff6-bf31efbd5791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b64e5d-9950-430b-9ff6-bf31efbd5791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c7ec84-7fc2-45cf-a7c5-9311691476b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c7ec84-7fc2-45cf-a7c5-9311691476b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6e4654-9dc3-40bb-a610-b2b8481400de', 'volume_name': 'volume-8d6e4654-9dc3-40bb-a610-b2b8481400de', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546ea788-4244-46c6-a0b7-c942a8d280ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546ea788-4244-46c6-a0b7-c942a8d280ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8250a8d2-862d-4329-bd18-a94aa5350a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Volume 8d6e4654-9dc3-40bb-a610-b2b8481400de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6e4654-9dc3-40bb-a610-b2b8481400de', 'volume_size': 1} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-757570421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6e4654-9dc3-40bb-a610-b2b8481400de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a472b86356444a2faa86bb0c93087929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:44Z,use_quota=True,user_id='816eb65d48a94e85ae23a6959cc2f874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Creating volume 8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:44 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:44 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de 1073741824 Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:44 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-f7eac13a-8320-401e-8aae-3c99ca14839e" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:44 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:44 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-f7eac13a-8320-401e-8aae-3c99ca14839e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Deleting offline snapshot 0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f of volume f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] snapshot_file for this snap is: volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577c491-4546-4481-8de5-60bf224a2d37]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:44 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.501s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Deleted volume successfully. Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-388ee6f8-ce86-4020-bf69-863f4e9a9d79 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-cc7aa26e-c8de-47fc-916a-389996f83538-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:44 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f Sep 02 00:57:44 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:44 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.559s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:44 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Deleted volume successfully. Sep 02 00:57:45 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de 1073741824" returned: 0 in 0.646s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6a83c69d-d25d-4d71-a8e9-3f9515ac2d5e tempest-CinderUnicodeTest-1496712242 None] Lock "cinder-9d654b8d-da5b-49b7-ba80-4d80304da78f-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:45 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de Sep 02 00:57:45 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:45 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" returned: 0 in 0.567s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7eac13a-8320-401e-8aae-3c99ca14839e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d0105-a391-4b31-ad7a-c141873fb47a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:45 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de" returned: 0 in 0.287s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8250a8d2-862d-4329-bd18-a94aa5350a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6e4654-9dc3-40bb-a610-b2b8481400de', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae12edb5-c28d-4f7d-80a7-5c1e43dcdacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Volume volume-8d6e4654-9dc3-40bb-a610-b2b8481400de (8d6e4654-9dc3-40bb-a610-b2b8481400de): created successfully Sep 02 00:57:45 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e Sep 02 00:57:45 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae12edb5-c28d-4f7d-80a7-5c1e43dcdacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Flow 'volume_create_manager' (e2cffaa2-aee2-47cc-8931-75a12dcc8fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c627711c-9f07-4041-a1bb-5c8ab4ad3579 tempest-VolumeDependencyTests-1601108631 None] Created volume successfully. Sep 02 00:57:45 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e" returned: 0 in 0.440s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:45 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f Sep 02 00:57:45 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:46 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:46 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f Sep 02 00:57:46 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:46 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e.0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f" released by "_delete_snapshot" :: held 1.909s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-f7eac13a-8320-401e-8aae-3c99ca14839e" released by "delete_snapshot" :: held 1.970s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Creating offline snapshot d8397a1a-78ec-4f48-b4c0-8e68def207bc of volume 8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Created reservations ['33e6b7f3-a313-4a34-8a4a-087582009b32', 'd1ee48a4-215c-48b0-8245-24be62478955', '6e04a184-cc1b-42aa-8265-90d9481bb896', '8f146467-54eb-4889-8cfb-7982bc04a5aa'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4806dd4-383a-4d7c-a14b-d75f5e772571]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Delete snapshot completed successfully. Sep 02 00:57:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cfe6ffc8-61a2-41fb-abd4-17efc50ba9b4 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-0cc9d6e8-1ab8-46dd-901b-8df2bcc7bb9f-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:46 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de Sep 02 00:57:46 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:47 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:47 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc 1G Sep 02 00:57:47 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:47 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-f7eac13a-8320-401e-8aae-3c99ca14839e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc 1G" returned: 0 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6e4654-9dc3-40bb-a610-b2b8481400de -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-f7eac13a-8320-401e-8aae-3c99ca14839e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:47 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6e4654-9dc3-40bb-a610-b2b8481400de -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc Sep 02 00:57:47 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "cinder-quobyte-f7eac13a-8320-401e-8aae-3c99ca14839e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-f7eac13a-8320-401e-8aae-3c99ca14839e" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17d0c7-7551-42a5-ab5c-309ee9a9499f]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:47 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e Sep 02 00:57:47 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:48 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d6e4654-9dc3-40bb-a610-b2b8481400de -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc is being set with open permissions: ugo+rw Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:48 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc Sep 02 00:57:48 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:48 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e" returned: 0 in 0.470s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:48 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e Sep 02 00:57:48 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:48 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:48 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.info Sep 02 00:57:48 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:48 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-f7eac13a-8320-401e-8aae-3c99ca14839e" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-quobyte-f7eac13a-8320-401e-8aae-3c99ca14839e" released by "delete_volume" :: held 0.921s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Created reservations ['695544f6-3697-486a-98fd-7313699fd26f', 'b465e271-4d07-4b37-9e2e-a79de65064ce', 'b5548a6f-5f38-454e-8b32-2775f66acc56', 'd2953654-fbc6-468f-875e-e0c7973be046'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:57:48 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.info" returned: 0 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.info is being set with open permissions: ugo+rw Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:48 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.info Sep 02 00:57:48 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:48 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:57:48 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:49 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.info" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d3fdbd3e-b9e5-4881-81c0-865c5460a994 tempest-VolumeDependencyTests-1601108631 None] Create snapshot completed successfully Sep 02 00:57:49 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:49 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:57:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Deleted volume successfully. Sep 02 00:57:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-278b73b0-3c6b-4c6c-b9c4-14b05fc83e22 tempest-CreateVolumesFromSnapshotTest-270619486 None] Lock "cinder-f7eac13a-8320-401e-8aae-3c99ca14839e-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Flow 'volume_create_manager' (6d79853d-fb5f-4d62-856f-858b9789e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14acf5a-4359-4663-9010-3f1d143e5abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14acf5a-4359-4663-9010-3f1d143e5abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-894700510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3165d1dc-989e-4bff-818f-8035eb6bda3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a472b86356444a2faa86bb0c93087929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8397a1a-78ec-4f48-b4c0-8e68def207bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:50Z,use_quota=True,user_id='816eb65d48a94e85ae23a6959cc2f874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da8299b-6639-45e8-8176-1a4e3cec6687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da8299b-6639-45e8-8176-1a4e3cec6687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d16f1cd-e64a-4fc1-bfc3-132c1bce9252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d16f1cd-e64a-4fc1-bfc3-132c1bce9252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3165d1dc-989e-4bff-818f-8035eb6bda3e', 'volume_name': 'volume-3165d1dc-989e-4bff-818f-8035eb6bda3e', 'volume_size': 1, 'snapshot_id': 'd8397a1a-78ec-4f48-b4c0-8e68def207bc'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0854d66-f0a4-417b-a62b-4f1eb5253c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0854d66-f0a4-417b-a62b-4f1eb5253c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853e488a-e581-46a3-912c-0b6ce014d616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Volume 3165d1dc-989e-4bff-818f-8035eb6bda3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3165d1dc-989e-4bff-818f-8035eb6bda3e', 'volume_size': 1, 'snapshot_id': 'd8397a1a-78ec-4f48-b4c0-8e68def207bc'} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-quobyte-d8397a1a-78ec-4f48-b4c0-8e68def207bc-3165d1dc-989e-4bff-818f-8035eb6bda3e" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-d8397a1a-78ec-4f48-b4c0-8e68def207bc-3165d1dc-989e-4bff-818f-8035eb6bda3e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Creating volume 3165d1dc-989e-4bff-818f-8035eb6bda3e from snapshot d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-quobyte-3165d1dc-989e-4bff-818f-8035eb6bda3e" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-3165d1dc-989e-4bff-818f-8035eb6bda3e" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] snapshot: d8397a1a-78ec-4f48-b4c0-8e68def207bc, volume: 3165d1dc-989e-4bff-818f-8035eb6bda3e, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[255fdd5a-8900-4584-9c6b-8f6ae88052c2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:50 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc Sep 02 00:57:50 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:51 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d6e4654-9dc3-40bb-a610-b2b8481400de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d7f6a4-7d12-455f-bcaa-5fd5521dbf9d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:51 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de Sep 02 00:57:51 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:51 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de" returned: 0 in 0.496s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:57:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:51 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e Sep 02 00:57:51 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (ee1f4a4f-63a6-4b2f-9456-1c51b9a30de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be77ee1e-05e9-48e9-860f-70e1c8c09eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be77ee1e-05e9-48e9-860f-70e1c8c09eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889391202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c09df26-a5b3-496b-abcf-b8137ade2908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:56Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe41c07c-c492-4743-b82a-93c5486a9067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe41c07c-c492-4743-b82a-93c5486a9067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5959ec3-5928-41d0-8814-c9552e6e058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5959ec3-5928-41d0-8814-c9552e6e058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c09df26-a5b3-496b-abcf-b8137ade2908', 'volume_name': 'volume-7c09df26-a5b3-496b-abcf-b8137ade2908', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11045b24-d6f9-445f-ab30-a2f6c616241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11045b24-d6f9-445f-ab30-a2f6c616241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbba20f-473a-45ac-9f2f-d09c8490ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume 7c09df26-a5b3-496b-abcf-b8137ade2908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c09df26-a5b3-496b-abcf-b8137ade2908', 'volume_size': 1} Sep 02 00:57:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:57 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e" returned: 0 in 6.068s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:57:57 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Converted 1024.00 MB image at 168.71 MB/s Sep 02 00:57:57 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e is being set with open permissions: ugo+rw Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:57 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e Sep 02 00:57:57 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (5f1951a9-a2dc-45df-b684-494dac3bc562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6875b41d-234d-4740-b24a-4d823774273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6875b41d-234d-4740-b24a-4d823774273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672791474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34813978-b5b2-4dbe-8c9e-e874eebf65ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:58Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff505b-8883-4c34-85de-14edb6b8f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ff505b-8883-4c34-85de-14edb6b8f535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebad8c9-850c-42b1-aa60-5f80330affe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ebad8c9-850c-42b1-aa60-5f80330affe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34813978-b5b2-4dbe-8c9e-e874eebf65ee', 'volume_name': 'volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb97d4c-0af4-4f3d-89a3-a4b92fe4c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb97d4c-0af4-4f3d-89a3-a4b92fe4c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b892ba53-34c5-4217-babc-c2b160b7fe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Volume 34813978-b5b2-4dbe-8c9e-e874eebf65ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee', 'volume_size': 1} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:58 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-3165d1dc-989e-4bff-818f-8035eb6bda3e" released by "_copy_volume_from_snapshot" :: held 7.404s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-d8397a1a-78ec-4f48-b4c0-8e68def207bc-3165d1dc-989e-4bff-818f-8035eb6bda3e" released by "_create_volume_from_snapshot" :: held 7.476s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.495s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.241s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-889391202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c09df26-a5b3-496b-abcf-b8137ade2908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:56Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Creating volume 7c09df26-a5b3-496b-abcf-b8137ade2908 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:58 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 1073741824 Sep 02 00:57:58 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853e488a-e581-46a3-912c-0b6ce014d616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3165d1dc-989e-4bff-818f-8035eb6bda3e', 'volume_size': 1, 'snapshot_id': 'd8397a1a-78ec-4f48-b4c0-8e68def207bc'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa5178b-867b-45ac-bcb9-2c5653b27aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Volume volume-3165d1dc-989e-4bff-818f-8035eb6bda3e (3165d1dc-989e-4bff-818f-8035eb6bda3e): created successfully Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa5178b-867b-45ac-bcb9-2c5653b27aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Flow 'volume_create_manager' (6d79853d-fb5f-4d62-856f-858b9789e67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-424da4d8-97ae-45cb-8281-66f7988c22b7 tempest-VolumeDependencyTests-1601108631 None] Created volume successfully. Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (e2c033c9-2a7d-465e-9bf9-0bdac477a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7c87a3-0010-4f2d-a654-95521128c3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7c87a3-0010-4f2d-a654-95521128c3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129515682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06a29b2-5f20-498f-92d6-63b4c01ac01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:58Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76431b94-72bb-4d85-96fe-0b12db4c14f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76431b94-72bb-4d85-96fe-0b12db4c14f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c370bf-cd28-4de6-bacf-94f6b1ce810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c370bf-cd28-4de6-bacf-94f6b1ce810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c06a29b2-5f20-498f-92d6-63b4c01ac01d', 'volume_name': 'volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020f8a2e-3680-4e93-a3b5-8eb954013df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020f8a2e-3680-4e93-a3b5-8eb954013df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518171c0-9ba8-47df-be42-1a985de6d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Volume c06a29b2-5f20-498f-92d6-63b4c01ac01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d', 'volume_size': 1} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:58 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 1073741824" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:58 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 Sep 02 00:57:58 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:58 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672791474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34813978-b5b2-4dbe-8c9e-e874eebf65ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:58Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Creating volume 34813978-b5b2-4dbe-8c9e-e874eebf65ee {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbba20f-473a-45ac-9f2f-d09c8490ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c09df26-a5b3-496b-abcf-b8137ade2908', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4861bf02-b395-42b1-bb4b-c3a34ee944f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:58 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee 1073741824 Sep 02 00:57:58 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume volume-7c09df26-a5b3-496b-abcf-b8137ade2908 (7c09df26-a5b3-496b-abcf-b8137ade2908): created successfully Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4861bf02-b395-42b1-bb4b-c3a34ee944f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (ee1f4a4f-63a6-4b2f-9456-1c51b9a30de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-29ba794e-8161-4ad6-ac8a-065d29f8a3e0 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created volume successfully. Sep 02 00:57:59 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee 1073741824" returned: 0 in 0.410s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-d8397a1a-78ec-4f48-b4c0-8e68def207bc-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:59 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee Sep 02 00:57:59 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-d8397a1a-78ec-4f48-b4c0-8e68def207bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-quobyte-8d6e4654-9dc3-40bb-a610-b2b8481400de" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-8d6e4654-9dc3-40bb-a610-b2b8481400de" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-quobyte-d8397a1a-78ec-4f48-b4c0-8e68def207bc" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-d8397a1a-78ec-4f48-b4c0-8e68def207bc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Deleting offline snapshot d8397a1a-78ec-4f48-b4c0-8e68def207bc of volume 8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] snapshot_file for this snap is: volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf168b84-7c1a-40e5-a272-1e0e2209b971]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:59 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc Sep 02 00:57:59 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:59 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129515682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06a29b2-5f20-498f-92d6-63b4c01ac01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:57:58Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Creating volume c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:57:59 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b892ba53-34c5-4217-babc-c2b160b7fe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:59 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d 1073741824 Sep 02 00:57:59 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782d0917-97bf-4c24-94f4-139f3bdc8c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:57:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Volume volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee (34813978-b5b2-4dbe-8c9e-e874eebf65ee): created successfully Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782d0917-97bf-4c24-94f4-139f3bdc8c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (5f1951a9-a2dc-45df-b684-494dac3bc562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:57:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-62a42340-7b49-464d-8377-46838735123b tempest-ProjectReaderTests-386837028 None] Created volume successfully. Sep 02 00:57:59 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d6e4654-9dc3-40bb-a610-b2b8481400de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[00745dcd-a109-45f5-961b-d9ffec076940]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:57:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:57:59 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de Sep 02 00:57:59 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:00 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d 1073741824" returned: 0 in 0.462s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:00 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d Sep 02 00:58:00 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-34813978-b5b2-4dbe-8c9e-e874eebf65ee-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Lock "cinder-34813978-b5b2-4dbe-8c9e-e874eebf65ee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-quobyte-34813978-b5b2-4dbe-8c9e-e874eebf65ee" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-34813978-b5b2-4dbe-8c9e-e874eebf65ee" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:00 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de" returned: 0 in 0.666s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:00 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce570f26-5a23-4835-8d66-1c512f69d25d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:00 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc Sep 02 00:58:00 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518171c0-9ba8-47df-be42-1a985de6d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5a562a-91d7-48d7-a9c3-0c519da27ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Volume volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d (c06a29b2-5f20-498f-92d6-63b4c01ac01d): created successfully Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5a562a-91d7-48d7-a9c3-0c519da27ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (e2c033c9-2a7d-465e-9bf9-0bdac477a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-13f231d7-d087-4987-9cf9-83f2c4a530fe tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:58:00 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee Sep 02 00:58:00 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (47d99b1c-f2e2-4590-b517-2c8ff2712aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d5753f-c7a1-48f0-8409-50ae633ed113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d5753f-c7a1-48f0-8409-50ae633ed113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026341653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890ef211-177b-4174-bc83-14e1beb76636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:01Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d65077c-c016-4711-b806-f2c17d830ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d65077c-c016-4711-b806-f2c17d830ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1747439-5f43-4983-a21c-f35e7e5cf078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1747439-5f43-4983-a21c-f35e7e5cf078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890ef211-177b-4174-bc83-14e1beb76636', 'volume_name': 'volume-890ef211-177b-4174-bc83-14e1beb76636', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8711af2c-8085-4c19-978b-a3e99f16db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8711af2c-8085-4c19-978b-a3e99f16db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f829ba-e67b-4c8b-bbd5-b038656730e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume 890ef211-177b-4174-bc83-14e1beb76636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890ef211-177b-4174-bc83-14e1beb76636', 'volume_size': 1} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026341653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890ef211-177b-4174-bc83-14e1beb76636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:01Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Creating volume 890ef211-177b-4174-bc83-14e1beb76636 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:00 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:00 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 1073741824 Sep 02 00:58:00 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:00 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc" returned: 0 in 0.515s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:01 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:01 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee" returned: 0 in 0.539s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:01 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:01 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee Sep 02 00:58:01 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (857be8cb-a727-41ba-b3a6-99dacbce3db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75309671-ea18-4342-8c35-dbe761faace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75309671-ea18-4342-8c35-dbe761faace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879415241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495fa84d-2d79-44bd-8e35-dfd7075f6477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:01Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977a379b-93bd-4a8c-af51-29d7081a0227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977a379b-93bd-4a8c-af51-29d7081a0227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fd0335-feca-4782-8c39-4ee8f495c417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fd0335-feca-4782-8c39-4ee8f495c417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495fa84d-2d79-44bd-8e35-dfd7075f6477', 'volume_name': 'volume-495fa84d-2d79-44bd-8e35-dfd7075f6477', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34d11dd-45ca-4813-afae-b3f47cfbffa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b34d11dd-45ca-4813-afae-b3f47cfbffa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ee807-430d-4228-871a-1e9b13f0b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume 495fa84d-2d79-44bd-8e35-dfd7075f6477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495fa84d-2d79-44bd-8e35-dfd7075f6477', 'volume_size': 1} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:01 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-34813978-b5b2-4dbe-8c9e-e874eebf65ee" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-34813978-b5b2-4dbe-8c9e-e874eebf65ee" released by "delete_volume" :: held 0.965s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:01 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de.d8397a1a-78ec-4f48-b4c0-8e68def207bc" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:01 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 1073741824" returned: 0 in 0.679s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-d8397a1a-78ec-4f48-b4c0-8e68def207bc" released by "_delete_snapshot" :: held 2.127s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-8d6e4654-9dc3-40bb-a610-b2b8481400de" released by "delete_snapshot" :: held 2.165s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Created reservations ['4ca01ad5-fab8-4338-9488-db878fcefa1a', '1cfdbf22-685b-41ea-a2b7-7ee13c6304e0', '125edf67-7b26-4195-b70a-7894283687c0', '77efab1f-40ac-4f4a-8dd1-617e5178ef02'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:01 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 Sep 02 00:58:01 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (5ca77e8f-87d4-443d-ae0c-8b3e842f5276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa3ddd2-54de-4594-87b9-b1dc0ed5517f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa3ddd2-54de-4594-87b9-b1dc0ed5517f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148399484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16643b24-2818-4656-86ef-5abd3c2831f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:02Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52c3349-9b55-4b38-847c-3e1c99e2b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52c3349-9b55-4b38-847c-3e1c99e2b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8107d3-4e3e-49f3-9c9d-92d74d14b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8107d3-4e3e-49f3-9c9d-92d74d14b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16643b24-2818-4656-86ef-5abd3c2831f9', 'volume_name': 'volume-16643b24-2818-4656-86ef-5abd3c2831f9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba6f014-446f-484e-95d7-28c2678d02e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba6f014-446f-484e-95d7-28c2678d02e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274edd87-bee9-4dee-8b0c-b3b0581969f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume 16643b24-2818-4656-86ef-5abd3c2831f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16643b24-2818-4656-86ef-5abd3c2831f9', 'volume_size': 1} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Created reservations ['f87e7d84-d397-414c-a10e-edecaf7eb128', '5f591792-6a0c-4aaf-ac88-a61e5835e247', '3b8dae77-5c2f-4002-b854-8dfe14129122', '589b61c2-6af5-40ae-8620-13d662b0f2c2'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:02 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.801s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:02 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:02 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879415241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495fa84d-2d79-44bd-8e35-dfd7075f6477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:01Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Creating volume 495fa84d-2d79-44bd-8e35-dfd7075f6477 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:02 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 1073741824 Sep 02 00:58:02 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f829ba-e67b-4c8b-bbd5-b038656730e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890ef211-177b-4174-bc83-14e1beb76636', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3425677f-85e4-4d79-aad8-40a8f314c309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Delete snapshot completed successfully. Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume volume-890ef211-177b-4174-bc83-14e1beb76636 (890ef211-177b-4174-bc83-14e1beb76636): created successfully Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3425677f-85e4-4d79-aad8-40a8f314c309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (47d99b1c-f2e2-4590-b517-2c8ff2712aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-77e5b994-d5f0-493a-8d43-716de537f555 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-d8397a1a-78ec-4f48-b4c0-8e68def207bc-delete_snapshot" released by "delete_snapshot" :: held 2.851s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (d942973c-f3eb-4cb3-a90d-cd0ae801df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9192db-9eb9-42b9-8fdd-90819b5dd54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-822a7923-4552-4910-894d-2e3375116f19 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created volume successfully. Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9192db-9eb9-42b9-8fdd-90819b5dd54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663518504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4552c3c5-a07c-489b-b6a3-52b655cb1ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:02Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be13712-9faa-48c9-b83a-3f41fe8ab2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be13712-9faa-48c9-b83a-3f41fe8ab2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b22f7f6-4032-4708-9ec3-bd40748b7792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b22f7f6-4032-4708-9ec3-bd40748b7792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4552c3c5-a07c-489b-b6a3-52b655cb1ac4', 'volume_name': 'volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fbdbe9-e975-40ca-a91e-8149370df6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fbdbe9-e975-40ca-a91e-8149370df6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35fa67c-7d69-4c8a-b4e3-7304b46eb2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume 4552c3c5-a07c-489b-b6a3-52b655cb1ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4', 'volume_size': 1} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Deleted volume successfully. Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b42f9804-b69a-45c4-b3a9-94cc30418d63 tempest-ProjectReaderTests-386837028 None] Lock "cinder-34813978-b5b2-4dbe-8c9e-e874eebf65ee-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:02 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 1073741824" returned: 0 in 0.565s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:02 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 Sep 02 00:58:02 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (c59c2985-f6c1-4dda-85e9-d32211588797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdf1993-89e5-4849-b732-85b6c02bf36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-8d6e4654-9dc3-40bb-a610-b2b8481400de-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdf1993-89e5-4849-b732-85b6c02bf36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643044898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a64f9b9-1567-4934-bd00-5dc38f210c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:03Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b434bb-4094-4da3-9478-58b795a3171a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b434bb-4094-4da3-9478-58b795a3171a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d258fbe-5e92-47f2-942d-ba2cd01833df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d258fbe-5e92-47f2-942d-ba2cd01833df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a64f9b9-1567-4934-bd00-5dc38f210c78', 'volume_name': 'volume-3a64f9b9-1567-4934-bd00-5dc38f210c78', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1e887-3039-49e7-a39a-84a93569b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1e887-3039-49e7-a39a-84a93569b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdc4c7d-24aa-4865-9620-110adf7d4cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume 3a64f9b9-1567-4934-bd00-5dc38f210c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a64f9b9-1567-4934-bd00-5dc38f210c78', 'volume_size': 1} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-8d6e4654-9dc3-40bb-a610-b2b8481400de-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-quobyte-8d6e4654-9dc3-40bb-a610-b2b8481400de" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-8d6e4654-9dc3-40bb-a610-b2b8481400de" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab9442c-3c3b-4b4d-a1d4-c48bc25e0879]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:02 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148399484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16643b24-2818-4656-86ef-5abd3c2831f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:02Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Creating volume 16643b24-2818-4656-86ef-5abd3c2831f9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ee807-430d-4228-871a-1e9b13f0b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495fa84d-2d79-44bd-8e35-dfd7075f6477', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a147d8c2-9003-482a-9ca5-9cfe3bd90c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:03 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 1073741824 Sep 02 00:58:03 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 (495fa84d-2d79-44bd-8e35-dfd7075f6477): created successfully Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a147d8c2-9003-482a-9ca5-9cfe3bd90c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (857be8cb-a727-41ba-b3a6-99dacbce3db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2c7d1146-cf8d-4929-bea3-52932a640bf3 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created volume successfully. Sep 02 00:58:03 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de Sep 02 00:58:03 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (95caac72-34cb-491b-b3b6-afbc2fa41e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125f9c46-23df-49b4-9104-192269e22732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125f9c46-23df-49b4-9104-192269e22732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298220235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc398ff-8c59-4525-bf32-c40dab600ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:03Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cf7cc7-f444-425d-9f4e-9cdf1a3893ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cf7cc7-f444-425d-9f4e-9cdf1a3893ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abf9a99-4361-42a9-9d50-3372c5cd1272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abf9a99-4361-42a9-9d50-3372c5cd1272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc398ff-8c59-4525-bf32-c40dab600ea9', 'volume_name': 'volume-ebc398ff-8c59-4525-bf32-c40dab600ea9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f51f0f-3b1d-4dc4-82aa-4501cb2ecd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f51f0f-3b1d-4dc4-82aa-4501cb2ecd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dc0e73-62cb-4e92-b118-cccd01da5217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Volume ebc398ff-8c59-4525-bf32-c40dab600ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc398ff-8c59-4525-bf32-c40dab600ea9', 'volume_size': 1} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:03 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:03 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de Sep 02 00:58:03 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:03 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 1073741824" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:03 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 Sep 02 00:58:03 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:03 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-8d6e4654-9dc3-40bb-a610-b2b8481400de" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-8d6e4654-9dc3-40bb-a610-b2b8481400de" released by "delete_volume" :: held 0.780s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Created reservations ['ceeac7de-52da-41a3-85d1-3eb7e025db89', '0782f616-300c-41e3-8526-afec9e0ec098', 'f8b5e764-e46f-443e-b7a3-2785c3da1af2', '594f4499-185c-47b3-96c7-93054a3f370a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:03 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663518504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4552c3c5-a07c-489b-b6a3-52b655cb1ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:02Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Creating volume 4552c3c5-a07c-489b-b6a3-52b655cb1ac4 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:03 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:03 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 1073741824 Sep 02 00:58:03 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274edd87-bee9-4dee-8b0c-b3b0581969f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16643b24-2818-4656-86ef-5abd3c2831f9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57afbd6-765a-4d2f-8df1-5b56de4363de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume volume-16643b24-2818-4656-86ef-5abd3c2831f9 (16643b24-2818-4656-86ef-5abd3c2831f9): created successfully Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57afbd6-765a-4d2f-8df1-5b56de4363de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (5ca77e8f-87d4-443d-ae0c-8b3e842f5276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b0d271c6-637e-41cf-88bf-3bee966ed17d tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created volume successfully. Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-3165d1dc-989e-4bff-818f-8035eb6bda3e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-3165d1dc-989e-4bff-818f-8035eb6bda3e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:03 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:03 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "cinder-quobyte-3165d1dc-989e-4bff-818f-8035eb6bda3e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-3165d1dc-989e-4bff-818f-8035eb6bda3e" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[463536d8-b5c0-4fc5-b9fe-d8e4bcdd3c81]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:04 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e Sep 02 00:58:04 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:04 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Deleted volume successfully. Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9426a0fd-007b-4766-b711-d2313e23c839 tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-8d6e4654-9dc3-40bb-a610-b2b8481400de-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:04 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 1073741824" returned: 0 in 0.469s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:04 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 Sep 02 00:58:04 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:04 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:04 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e Sep 02 00:58:04 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:04 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.128s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35fa67c-7d69-4c8a-b4e3-7304b46eb2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28113833-b730-48e3-8b15-e04a9cfa28fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot f40120c3-d066-43e6-9177-e1980452e7ff of volume c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 (4552c3c5-a07c-489b-b6a3-52b655cb1ac4): created successfully Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28113833-b730-48e3-8b15-e04a9cfa28fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (d942973c-f3eb-4cb3-a90d-cd0ae801df5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02aad26-2b79-43ec-a81c-fc01d1e51fbb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d7b49ca5-0f79-43b1-a42a-776703bb7a5a tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created volume successfully. Sep 02 00:58:04 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3165d1dc-989e-4bff-818f-8035eb6bda3e" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-quobyte-3165d1dc-989e-4bff-818f-8035eb6bda3e" released by "delete_volume" :: held 0.708s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:04 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d Sep 02 00:58:04 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Created reservations ['b115313a-5374-406a-bf02-146110d78e7f', 'b98574ae-5ca9-4803-91dc-91bcc58f9bf6', '3b6381b4-0a84-44e2-b17e-707d93a0ea88', '13d6f2ab-f148-46b6-83d6-90a3a02a8f14'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:04 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:04 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:04 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:05 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff 1G Sep 02 00:58:05 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:05 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Deleted volume successfully. Sep 02 00:58:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-94933a96-e820-4cc6-b714-57e5562e626b tempest-VolumeDependencyTests-1601108631 None] Lock "cinder-3165d1dc-989e-4bff-818f-8035eb6bda3e-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:05 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff 1G" returned: 0 in 0.432s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:05 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff Sep 02 00:58:05 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:05 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:05 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff is being set with open permissions: ugo+rw Sep 02 00:58:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:05 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff Sep 02 00:58:05 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:06 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:06 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.info Sep 02 00:58:06 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:06 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.info" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:06 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.info is being set with open permissions: ugo+rw Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:06 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.info Sep 02 00:58:06 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:06 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.info" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.773s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643044898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a64f9b9-1567-4934-bd00-5dc38f210c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df999ec1ba546dfb7b80b5a6461bcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:03Z,use_quota=True,user_id='c76c514d5bb24d2ab907780da5d49bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Creating volume 3a64f9b9-1567-4934-bd00-5dc38f210c78 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:06 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:06 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 1073741824 Sep 02 00:58:06 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4e58bf77-cd05-45f5-90df-ae421c430e21 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:58:07 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 1073741824" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:07 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 Sep 02 00:58:07 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:07 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.171s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298220235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc398ff-8c59-4525-bf32-c40dab600ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:03Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Creating volume ebc398ff-8c59-4525-bf32-c40dab600ea9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:07 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdc4c7d-24aa-4865-9620-110adf7d4cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a64f9b9-1567-4934-bd00-5dc38f210c78', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:07 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 1073741824 Sep 02 00:58:07 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4a76c3-a18d-47b6-a830-e443113f2002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:07 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Volume volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 (3a64f9b9-1567-4934-bd00-5dc38f210c78): created successfully Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4a76c3-a18d-47b6-a830-e443113f2002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Flow 'volume_create_manager' (c59c2985-f6c1-4dda-85e9-d32211588797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f24ce9d8-1e90-4387-a70e-8bed79e23fa6 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created volume successfully. Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-f40120c3-d066-43e6-9177-e1980452e7ff-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-f40120c3-d066-43e6-9177-e1980452e7ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-c06a29b2-5f20-498f-92d6-63b4c01ac01d" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c06a29b2-5f20-498f-92d6-63b4c01ac01d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-f40120c3-d066-43e6-9177-e1980452e7ff" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-f40120c3-d066-43e6-9177-e1980452e7ff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot f40120c3-d066-43e6-9177-e1980452e7ff of volume c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[05470384-4b00-439f-ab17-5688db5656d6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:07 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff Sep 02 00:58:07 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:07 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 1073741824" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:07 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 Sep 02 00:58:07 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:08 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795ab49-ae69-4bd1-a673-ab0c1d2dfab6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:08 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-3a64f9b9-1567-4934-bd00-5dc38f210c78-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9" returned: 0 in 0.285s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dc0e73-62cb-4e92-b118-cccd01da5217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc398ff-8c59-4525-bf32-c40dab600ea9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dc900d-32df-4cfd-a18e-baa20c286444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-3a64f9b9-1567-4934-bd00-5dc38f210c78-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Volume volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 (ebc398ff-8c59-4525-bf32-c40dab600ea9): created successfully Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dc900d-32df-4cfd-a18e-baa20c286444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (95caac72-34cb-491b-b3b6-afbc2fa41e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-quobyte-3a64f9b9-1567-4934-bd00-5dc38f210c78" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d0754a5c-55ba-4c87-a4d6-f039a0cca78c tempest-ProjectReaderTests-386837028 None] Created volume successfully. Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-3a64f9b9-1567-4934-bd00-5dc38f210c78" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a953799-d5df-441f-ad48-8bfb1e88b0e8]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:08 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9d09b089-b965-42bd-8a30-e358aa2d2a13 tempest-ProjectAdminTests-205971486 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9354515075684, 'free_capacity_gb': 1773.9354515075684, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 02 00:58:08 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:08 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 Sep 02 00:58:08 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-ebc398ff-8c59-4525-bf32-c40dab600ea9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Lock "cinder-ebc398ff-8c59-4525-bf32-c40dab600ea9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-quobyte-ebc398ff-8c59-4525-bf32-c40dab600ea9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-ebc398ff-8c59-4525-bf32-c40dab600ea9" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:08 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d" returned: 0 in 0.640s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7552b380-06a3-4d9b-b5b9-9b7e50c715bb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:08 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff Sep 02 00:58:08 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:08 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78" returned: 0 in 0.498s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:08 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 Sep 02 00:58:08 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:08 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78 Sep 02 00:58:08 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:09 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:09 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff" returned: 0 in 0.444s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:09 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9" returned: 0 in 0.447s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3a64f9b9-1567-4934-bd00-5dc38f210c78" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:09 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff Sep 02 00:58:09 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-3a64f9b9-1567-4934-bd00-5dc38f210c78" released by "delete_volume" :: held 0.942s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:09 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9 Sep 02 00:58:09 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created reservations ['305dce16-bf41-48c7-8ac4-964fa03f7686', 'd4d167ae-34b0-46cc-b35a-1ff69544c16b', '4a98d997-06e0-4235-a370-72d31bdf724d', '0dc5932d-20af-4053-a2da-f60c11ed36d7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:09 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:09 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:09 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:09 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d.f40120c3-d066-43e6-9177-e1980452e7ff" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-ebc398ff-8c59-4525-bf32-c40dab600ea9" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-ebc398ff-8c59-4525-bf32-c40dab600ea9" released by "delete_volume" :: held 0.854s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-f40120c3-d066-43e6-9177-e1980452e7ff" released by "_delete_snapshot" :: held 1.994s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c06a29b2-5f20-498f-92d6-63b4c01ac01d" released by "delete_snapshot" :: held 2.020s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Created reservations ['751f9ca7-044b-4f53-9bf6-7b61e104535c', 'd600be7f-0dd1-4f4f-ba99-87e50cca32c7', 'a8387922-3dac-4f30-91ae-e17ea7c59c73', '432df7c6-484e-415b-99b3-6e06aab1a865'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Created reservations ['d790d727-601e-455a-8aed-e0784fef6673', 'e829cbfc-3f91-413d-a7f5-083405ed2f4a', '4f059aa0-6e46-45f3-bd29-8c76fbb04ec0', '8ba53dfa-4662-48d8-bff4-6135ba22e747'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:09 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.317s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Deleted volume successfully. Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18cab891-47f7-4b81-a2ac-c871f7850465 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-3a64f9b9-1567-4934-bd00-5dc38f210c78-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:09 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:09 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:58:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8779e684-a921-4bc4-b069-95d138487131 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-f40120c3-d066-43e6-9177-e1980452e7ff-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:10 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Deleted volume successfully. Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e2174ac-e1b1-4bfb-86da-4baad7de0240 tempest-ProjectReaderTests-386837028 None] Lock "cinder-ebc398ff-8c59-4525-bf32-c40dab600ea9-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (9807f639-2545-4f95-af06-e4db11fd9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f083580-466e-4858-a2f9-bad4af5b8631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f083580-466e-4858-a2f9-bad4af5b8631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482587818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9391967-cea4-4a0e-a254-cf7ff1637d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:10Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e10fcbd-d156-42f0-b950-6ca3db57e5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e10fcbd-d156-42f0-b950-6ca3db57e5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ad0b92-8e8a-48ac-ab75-13b9dcb40056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ad0b92-8e8a-48ac-ab75-13b9dcb40056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9391967-cea4-4a0e-a254-cf7ff1637d23', 'volume_name': 'volume-b9391967-cea4-4a0e-a254-cf7ff1637d23', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e0b3b9-c497-4f8e-b4c1-6379010dbacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e0b3b9-c497-4f8e-b4c1-6379010dbacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d121f2e1-9945-4568-8094-eb986b01903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Volume b9391967-cea4-4a0e-a254-cf7ff1637d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9391967-cea4-4a0e-a254-cf7ff1637d23', 'volume_size': 1} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1482587818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9391967-cea4-4a0e-a254-cf7ff1637d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:10Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Creating volume b9391967-cea4-4a0e-a254-cf7ff1637d23 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:10 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-4552c3c5-a07c-489b-b6a3-52b655cb1ac4-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-4552c3c5-a07c-489b-b6a3-52b655cb1ac4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:10 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 1073741824 Sep 02 00:58:10 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-quobyte-4552c3c5-a07c-489b-b6a3-52b655cb1ac4" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-4552c3c5-a07c-489b-b6a3-52b655cb1ac4" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[38853709-8f80-46f7-bb42-c4d692d5d469]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:10 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 Sep 02 00:58:10 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-c06a29b2-5f20-498f-92d6-63b4c01ac01d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-c06a29b2-5f20-498f-92d6-63b4c01ac01d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-c06a29b2-5f20-498f-92d6-63b4c01ac01d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c06a29b2-5f20-498f-92d6-63b4c01ac01d" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336281d-8c6c-459d-be82-fe0804a9e330]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:11 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 1073741824" returned: 0 in 0.559s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:11 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d Sep 02 00:58:11 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:11 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:11 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 Sep 02 00:58:11 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:11 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4 Sep 02 00:58:11 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:11 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d" returned: 0 in 0.473s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:11 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:11 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d Sep 02 00:58:11 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:11 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-4552c3c5-a07c-489b-b6a3-52b655cb1ac4" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d121f2e1-9945-4568-8094-eb986b01903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9391967-cea4-4a0e-a254-cf7ff1637d23', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d923e56d-d5a6-490c-8efa-26afe6108273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-4552c3c5-a07c-489b-b6a3-52b655cb1ac4" released by "delete_volume" :: held 0.939s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Volume volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 (b9391967-cea4-4a0e-a254-cf7ff1637d23): created successfully Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d923e56d-d5a6-490c-8efa-26afe6108273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (9807f639-2545-4f95-af06-e4db11fd9093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e3bda86f-7eac-40b6-9e02-b7195ca56bb7 tempest-ProjectReaderTests-386837028 None] Created volume successfully. Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created reservations ['d001ed47-3b85-46d1-9edc-03dd2efe7ad9', 'd9bcf045-5e2d-47f3-a353-13db87d12b78', 'db7fb46d-4e48-4594-8887-d00207bc99f8', 'cbcc801a-2cd8-44ae-b62b-f2f726d3cafa'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:11 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:11 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c06a29b2-5f20-498f-92d6-63b4c01ac01d" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:11 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c06a29b2-5f20-498f-92d6-63b4c01ac01d" released by "delete_volume" :: held 0.826s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Created reservations ['46bb0d91-97f7-4541-a995-2d12848e15fa', '248944ad-5de4-4d0d-b19d-bc32e4b1379d', '91f17881-894a-466f-b392-b1bb7ea1a52d', '726e6ecb-2133-434a-b29b-89bded5bf895'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:11 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:11 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:11 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.272s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:11 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Deleted volume successfully. Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-175724ca-9a7b-4091-95dd-1e92e77b0a43 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-4552c3c5-a07c-489b-b6a3-52b655cb1ac4-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:12 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:58:12 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:12 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f3e7a82-e29c-4054-97fb-c88aa15ed924 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-c06a29b2-5f20-498f-92d6-63b4c01ac01d-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:12 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (01a7df56-64d4-4218-9a5d-bc94f0eccab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c7890d-0e7b-4042-8df4-3d5402f41625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-b9391967-cea4-4a0e-a254-cf7ff1637d23-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c7890d-0e7b-4042-8df4-3d5402f41625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836278169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b0d81e-ee3b-4d2b-975a-a093f097daa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:13Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3510ae-fe07-475c-9865-8e3a5d177705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3510ae-fe07-475c-9865-8e3a5d177705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477b55ad-1dab-4e2a-af24-363be40cfd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477b55ad-1dab-4e2a-af24-363be40cfd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b0d81e-ee3b-4d2b-975a-a093f097daa9', 'volume_name': 'volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964a4033-8cf1-488f-a720-ddf2d6d9ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964a4033-8cf1-488f-a720-ddf2d6d9ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16c44eb-d5ac-4053-861f-9d61bb52579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Volume 09b0d81e-ee3b-4d2b-975a-a093f097daa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9', 'volume_size': 1} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836278169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b0d81e-ee3b-4d2b-975a-a093f097daa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:13Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Creating volume 09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:12 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:12 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 1073741824 Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Lock "cinder-b9391967-cea4-4a0e-a254-cf7ff1637d23-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:12 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-quobyte-b9391967-cea4-4a0e-a254-cf7ff1637d23" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-b9391967-cea4-4a0e-a254-cf7ff1637d23" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-16643b24-2818-4656-86ef-5abd3c2831f9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc71b4d-59dc-499e-be65-0586f5651d61]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-16643b24-2818-4656-86ef-5abd3c2831f9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-quobyte-16643b24-2818-4656-86ef-5abd3c2831f9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-16643b24-2818-4656-86ef-5abd3c2831f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade3dd5-cc12-4d4a-8160-93ed7ac86783]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:13 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 Sep 02 00:58:13 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:13 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 Sep 02 00:58:13 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:13 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 1073741824" returned: 0 in 0.633s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:13 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23" returned: 0 in 0.502s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:13 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23 Sep 02 00:58:13 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Flow 'volume_create_manager' (7d80909c-3719-4208-a3c0-05fc2bc5d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ebf1d6-61b4-4de4-b40e-834490d27e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:13 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9" returned: 0 in 0.438s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ebf1d6-61b4-4de4-b40e-834490d27e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375023144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8200359-4e54-492b-91fe-8950a99d0468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b3415e3be40b7bae6e6ac00f0f6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:13Z,use_quota=True,user_id='b9bcb82806c348b89b1ab772a1393c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610d3dc3-ee65-4d16-8546-7fc58355e6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (610d3dc3-ee65-4d16-8546-7fc58355e6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:13 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9 Sep 02 00:58:13 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b00dda3-d910-4baa-9250-d7fb62068d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b00dda3-d910-4baa-9250-d7fb62068d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8200359-4e54-492b-91fe-8950a99d0468', 'volume_name': 'volume-e8200359-4e54-492b-91fe-8950a99d0468', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958680dd-146e-4256-bd42-14ea7b24c0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958680dd-146e-4256-bd42-14ea7b24c0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2f603d-4254-4d1f-b439-ce5b862ba0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Volume e8200359-4e54-492b-91fe-8950a99d0468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8200359-4e54-492b-91fe-8950a99d0468', 'volume_size': 1} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:13 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 Sep 02 00:58:13 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:13 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-b9391967-cea4-4a0e-a254-cf7ff1637d23" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-b9391967-cea4-4a0e-a254-cf7ff1637d23" released by "delete_volume" :: held 0.829s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Created reservations ['c68cc38d-b4b2-4e5f-97cc-3bf3a65a6e6f', 'b6813cfc-e183-4e19-8160-4e7c8c8b0bc4', '7dddef0d-0568-44e8-8002-f4f6874f624c', '9eaf358d-b18e-42b1-8e71-fe7da27e7923'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:13 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-16643b24-2818-4656-86ef-5abd3c2831f9" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-16643b24-2818-4656-86ef-5abd3c2831f9" released by "delete_volume" :: held 0.779s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:13 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375023144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8200359-4e54-492b-91fe-8950a99d0468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b3415e3be40b7bae6e6ac00f0f6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:13Z,use_quota=True,user_id='b9bcb82806c348b89b1ab772a1393c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Creating volume e8200359-4e54-492b-91fe-8950a99d0468 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:13 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:13 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 1073741824 Sep 02 00:58:13 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16c44eb-d5ac-4053-861f-9d61bb52579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31d1e92-69e6-4b1a-af60-2cc830dc717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:13 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:13 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Volume volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 (09b0d81e-ee3b-4d2b-975a-a093f097daa9): created successfully Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31d1e92-69e6-4b1a-af60-2cc830dc717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (01a7df56-64d4-4218-9a5d-bc94f0eccab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created reservations ['30e17a41-79e1-4d18-9ce9-135f6901d36f', '79182d8f-ecdc-405d-9f61-84e66b5de650', '47f815bd-7e74-4de7-bcd6-86a38e6bb20f', 'f3b500e8-7d0e-409c-b01c-e532f794ebb0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-13c07d65-c52e-4f3a-83c6-574eac839db1 tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:14 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:14 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-495fa84d-2d79-44bd-8e35-dfd7075f6477-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-495fa84d-2d79-44bd-8e35-dfd7075f6477-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-quobyte-495fa84d-2d79-44bd-8e35-dfd7075f6477" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-495fa84d-2d79-44bd-8e35-dfd7075f6477" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:14 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.461s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Deleted volume successfully. Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[643200ad-25e3-4eff-9d4c-8f473aceda2b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c51468e2-afb6-4cff-98d6-440f217d43a7 tempest-ProjectReaderTests-386837028 None] Lock "cinder-b9391967-cea4-4a0e-a254-cf7ff1637d23-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:14 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Deleted volume successfully. Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5f0125d7-4f89-4483-81fa-d1a8ef20140b tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-16643b24-2818-4656-86ef-5abd3c2831f9-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:14 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 1073741824" returned: 0 in 0.691s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:14 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 Sep 02 00:58:14 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (c1dd8864-7f3c-4c49-9bf5-489833baa7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a55897-e688-4de7-9787-d277b3181243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a55897-e688-4de7-9787-d277b3181243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070681768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7b320b-46e5-4581-8519-554b0624e5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:14Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7f004b-f47b-40a2-b099-8c08e51fdd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7f004b-f47b-40a2-b099-8c08e51fdd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:14 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 Sep 02 00:58:14 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c773cc5-101e-4128-8cca-1f298e260a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c773cc5-101e-4128-8cca-1f298e260a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7b320b-46e5-4581-8519-554b0624e5f1', 'volume_name': 'volume-3c7b320b-46e5-4581-8519-554b0624e5f1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6827a3-35bc-410e-bcb1-33a2902f8391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6827a3-35bc-410e-bcb1-33a2902f8391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ad91d5-73f3-4182-9a7c-96b151ad68b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Volume 3c7b320b-46e5-4581-8519-554b0624e5f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7b320b-46e5-4581-8519-554b0624e5f1', 'volume_size': 1} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:14 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477" returned: 0 in 0.468s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:14 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477 Sep 02 00:58:14 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:14 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.244s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070681768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7b320b-46e5-4581-8519-554b0624e5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a9c8144268479eb35289306c873897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:14Z,use_quota=True,user_id='03e309c5963843119531cfa94aec19d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Creating volume 3c7b320b-46e5-4581-8519-554b0624e5f1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2f603d-4254-4d1f-b439-ce5b862ba0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8200359-4e54-492b-91fe-8950a99d0468', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:14 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 1073741824 Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f125dd-e838-45d8-b601-f93b8314e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:14 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Volume volume-e8200359-4e54-492b-91fe-8950a99d0468 (e8200359-4e54-492b-91fe-8950a99d0468): created successfully Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f125dd-e838-45d8-b601-f93b8314e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Flow 'volume_create_manager' (7d80909c-3719-4208-a3c0-05fc2bc5d630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e9024828-e47f-4f40-be2e-74b1c6735c45 tempest-ProjectReaderTests-1916336761 None] Created volume successfully. Sep 02 00:58:15 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-495fa84d-2d79-44bd-8e35-dfd7075f6477" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-495fa84d-2d79-44bd-8e35-dfd7075f6477" released by "delete_volume" :: held 0.827s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created reservations ['d6824378-10d6-4d92-aca1-f5f8d03993ed', 'fe4372e9-cf1a-44ab-83f1-bd0dfd15740e', 'd91eda27-17b7-45de-a8b9-ae9c6e687e8a', '2d262137-1c4d-4e5e-80c9-efc63864e390'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:15 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:15 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:15 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 1073741824" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-890ef211-177b-4174-bc83-14e1beb76636-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-890ef211-177b-4174-bc83-14e1beb76636-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:15 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 Sep 02 00:58:15 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-quobyte-890ef211-177b-4174-bc83-14e1beb76636" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-890ef211-177b-4174-bc83-14e1beb76636" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:15 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cbb044-f8d6-45a0-977c-43620e00ca95]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Deleted volume successfully. Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f4306445-ac30-469b-a54b-0b2e0031aa22 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-495fa84d-2d79-44bd-8e35-dfd7075f6477-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:15 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 Sep 02 00:58:15 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:15 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1" returned: 0 in 0.285s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.848s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ad91d5-73f3-4182-9a7c-96b151ad68b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7b320b-46e5-4581-8519-554b0624e5f1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8412ac8-63a0-47f7-beb9-bf62dc4ab5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot d8165e87-bb70-4096-aea5-cf9e792e9003 of volume 09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Volume volume-3c7b320b-46e5-4581-8519-554b0624e5f1 (3c7b320b-46e5-4581-8519-554b0624e5f1): created successfully Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8412ac8-63a0-47f7-beb9-bf62dc4ab5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Flow 'volume_create_manager' (c1dd8864-7f3c-4c49-9bf5-489833baa7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aec99f-7b94-4bdf-a48d-0096d69912cf]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "cinder-e8200359-4e54-492b-91fe-8950a99d0468-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1c024c3c-6cf7-48c9-96cb-eb4d9d99e887 tempest-ProjectReaderTests-386837028 None] Created volume successfully. Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-e8200359-4e54-492b-91fe-8950a99d0468-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "cinder-quobyte-e8200359-4e54-492b-91fe-8950a99d0468" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-quobyte-e8200359-4e54-492b-91fe-8950a99d0468" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9433a5b-9cc8-4c5c-8fbe-27f4d3a96e68]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:15 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 Sep 02 00:58:15 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:15 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636" returned: 0 in 0.426s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:16 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636 Sep 02 00:58:16 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:16 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 Sep 02 00:58:16 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:16 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:16 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-890ef211-177b-4174-bc83-14e1beb76636" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:16 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 1G Sep 02 00:58:16 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-890ef211-177b-4174-bc83-14e1beb76636" released by "delete_volume" :: held 0.744s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created reservations ['6ee28673-d7c2-4329-976a-79cc8b280c29', 'ade79d7d-9bf6-42b4-a04c-39d55775e565', '6b7a8c49-e8e1-4910-a2db-6a55647664a1', 'fcddf391-d738-4fc9-b6aa-7d72359c055c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:16 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468" returned: 0 in 0.396s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:16 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468 Sep 02 00:58:16 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:16 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:16 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-7c09df26-a5b3-496b-abcf-b8137ade2908-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:16 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-e8200359-4e54-492b-91fe-8950a99d0468" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-quobyte-e8200359-4e54-492b-91fe-8950a99d0468" released by "delete_volume" :: held 0.769s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-7c09df26-a5b3-496b-abcf-b8137ade2908-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:16 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "cinder-quobyte-7c09df26-a5b3-496b-abcf-b8137ade2908" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Deleted volume successfully. Sep 02 00:58:16 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-7c09df26-a5b3-496b-abcf-b8137ade2908" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d73cac6a-8989-4c45-8818-eb99ed1aa3a5 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-890ef211-177b-4174-bc83-14e1beb76636-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 1G" returned: 0 in 0.610s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Created reservations ['7408f132-5902-40ab-91a8-f96b41073529', '904221df-6bc1-45f7-9a6e-9cafbc283492', '9f47199f-21ec-43d2-b9d5-5efd71baadcc', '5b5c01af-7ebb-4d71-80f8-6d27850b3dc8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b2072a-5752-4ef8-859f-b601e0732460]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:16 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 Sep 02 00:58:16 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-3c7b320b-46e5-4581-8519-554b0624e5f1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Lock "cinder-3c7b320b-46e5-4581-8519-554b0624e5f1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:17 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:17 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:17 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:17 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Acquiring lock "cinder-quobyte-3c7b320b-46e5-4581-8519-554b0624e5f1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-3c7b320b-46e5-4581-8519-554b0624e5f1" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a43bd1-24b2-4188-a74b-b6922c0175e2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:17 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:17 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 is being set with open permissions: ugo+rw Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:17 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 Sep 02 00:58:17 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:17 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 Sep 02 00:58:17 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:17 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Deleted volume successfully. Sep 02 00:58:17 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a973c66d-7ad1-41d7-9e08-123235666c47 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-e8200359-4e54-492b-91fe-8950a99d0468-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908" returned: 0 in 0.709s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:17 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908 Sep 02 00:58:17 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:17 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003" returned: 0 in 0.421s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:17 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:17 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1 Sep 02 00:58:17 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:17 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.info Sep 02 00:58:17 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Flow 'volume_create_manager' (258b33e1-8f45-4efc-85db-92883678dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73049542-445f-4c8c-8b0b-55abc5cfc2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73049542-445f-4c8c-8b0b-55abc5cfc2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968926689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c49c57b-99e9-45cc-80b4-c585bc61687f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b3415e3be40b7bae6e6ac00f0f6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:18Z,use_quota=True,user_id='b9bcb82806c348b89b1ab772a1393c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cbcd4f-c2d9-4af7-8af3-772c0f2a757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cbcd4f-c2d9-4af7-8af3-772c0f2a757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48796422-9df8-4012-b438-2c92c192dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48796422-9df8-4012-b438-2c92c192dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c49c57b-99e9-45cc-80b4-c585bc61687f', 'volume_name': 'volume-5c49c57b-99e9-45cc-80b4-c585bc61687f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7dd0ef-acd3-4c04-8d91-5b2974792a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7dd0ef-acd3-4c04-8d91-5b2974792a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a13f00-8e2e-4f2f-9714-f154b68be537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Volume 5c49c57b-99e9-45cc-80b4-c585bc61687f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c49c57b-99e9-45cc-80b4-c585bc61687f', 'volume_size': 1} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:17 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-7c09df26-a5b3-496b-abcf-b8137ade2908" returned: 0 in 0.308s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-quobyte-7c09df26-a5b3-496b-abcf-b8137ade2908" released by "delete_volume" :: held 1.077s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Created reservations ['7ba89572-a8b0-4cbc-92fa-5148592ed3f3', '3a1d61b8-33ad-4811-a327-4255b7e99966', '5d8b80f3-3b02-4bb4-add1-93d562cc4798', '8428eaf6-0473-403d-b762-eb0eb406fa0a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:17 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-3c7b320b-46e5-4581-8519-554b0624e5f1" returned: 0 in 0.300s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Lock "cinder-quobyte-3c7b320b-46e5-4581-8519-554b0624e5f1" released by "delete_volume" :: held 0.847s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:18 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.info" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:18 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.info is being set with open permissions: ugo+rw Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:18 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:18 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:18 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.info Sep 02 00:58:18 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Created reservations ['d699b5d4-f9de-4b09-ae31-28c84cd0a711', '665c37c9-6d8b-4820-8157-c52ad8b97ff0', '96f6845f-4d62-4fa6-920f-a407ea615821', '161b1587-125a-4985-ad32-d68e78c79327'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:18 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:18 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:18 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Deleted volume successfully. Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b896c23a-ff45-499d-a60b-c1aec40aad68 tempest-CreateVolumesFromSourceVolumeTest-950217230 None] Lock "cinder-7c09df26-a5b3-496b-abcf-b8137ade2908-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:18 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.info" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968926689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c49c57b-99e9-45cc-80b4-c585bc61687f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164b3415e3be40b7bae6e6ac00f0f6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:18Z,use_quota=True,user_id='b9bcb82806c348b89b1ab772a1393c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Creating volume 5c49c57b-99e9-45cc-80b4-c585bc61687f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:18 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:18 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f 1073741824 Sep 02 00:58:18 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=252,cinder:UPDATE=346,cinder:INSERT=85,cinder:DELETE=36 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:58:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d3a45c5-250e-4b22-9b3c-a8e1d7964530 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=339,cinder:SELECT=238,cinder:DELETE=25,cinder:INSERT=87 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:58:18 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Deleted volume successfully. Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5451d4e0-cea7-4bdb-83fb-621ca7833ec1 tempest-ProjectReaderTests-386837028 None] Lock "cinder-3c7b320b-46e5-4581-8519-554b0624e5f1-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:18 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f 1073741824" returned: 0 in 0.518s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:18 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f Sep 02 00:58:18 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-d8165e87-bb70-4096-aea5-cf9e792e9003-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-d8165e87-bb70-4096-aea5-cf9e792e9003-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-09b0d81e-ee3b-4d2b-975a-a093f097daa9" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-09b0d81e-ee3b-4d2b-975a-a093f097daa9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-d8165e87-bb70-4096-aea5-cf9e792e9003" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-d8165e87-bb70-4096-aea5-cf9e792e9003" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot d8165e87-bb70-4096-aea5-cf9e792e9003 of volume 09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:19 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b188cd-011a-471f-8c28-6991bb89fa0c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a13f00-8e2e-4f2f-9714-f154b68be537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c49c57b-99e9-45cc-80b4-c585bc61687f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2737966-8837-478e-afb1-f7d3cf7632b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:19 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Volume volume-5c49c57b-99e9-45cc-80b4-c585bc61687f (5c49c57b-99e9-45cc-80b4-c585bc61687f): created successfully Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2737966-8837-478e-afb1-f7d3cf7632b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Flow 'volume_create_manager' (258b33e1-8f45-4efc-85db-92883678dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c787d4c7-21f9-49ed-8f74-4473d841bb9a tempest-ProjectReaderTests-1916336761 None] Created volume successfully. Sep 02 00:58:19 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 Sep 02 00:58:19 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:19 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "cinder-5c49c57b-99e9-45cc-80b4-c585bc61687f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47be85-16c3-46d1-a8bf-a7408e0017cc]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-5c49c57b-99e9-45cc-80b4-c585bc61687f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "cinder-quobyte-5c49c57b-99e9-45cc-80b4-c585bc61687f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-quobyte-5c49c57b-99e9-45cc-80b4-c585bc61687f" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:19 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 Sep 02 00:58:19 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a91f32-f88b-445e-a89d-b2dc5e600f6c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:20 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f Sep 02 00:58:20 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:20 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:20 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 Sep 02 00:58:20 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:20 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f" returned: 0 in 0.491s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:20 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f Sep 02 00:58:20 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:20 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:20 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003 Sep 02 00:58:20 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:20 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-5c49c57b-99e9-45cc-80b4-c585bc61687f" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-quobyte-5c49c57b-99e9-45cc-80b4-c585bc61687f" released by "delete_volume" :: held 0.861s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Created reservations ['2b04a759-7be7-486b-ae85-036a55ff19e9', '2f1f8d91-91a4-450b-979b-24ba69084a80', '760f19da-2677-4d07-ae47-6c31a6bff65b', 'eab721d1-1c84-43e8-9f6a-42c021503f92'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:20 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:20 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:20 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9.d8165e87-bb70-4096-aea5-cf9e792e9003" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-d8165e87-bb70-4096-aea5-cf9e792e9003" released by "_delete_snapshot" :: held 1.839s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-09b0d81e-ee3b-4d2b-975a-a093f097daa9" released by "delete_snapshot" :: held 1.877s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Created reservations ['6c9f2cbe-be00-4cc4-9d90-90f6a00bdd74', 'd892d182-9117-416c-b233-07d142769b30', '93e11547-beda-4abe-a776-900906034e66', '73cf95b2-79fd-4a33-9a15-2abd1cfb0bff'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:58:21 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1086d9ad-7e79-454f-9e0d-a8fe5d1757b4 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-d8165e87-bb70-4096-aea5-cf9e792e9003-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Deleted volume successfully. Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4c6ac174-47a0-4306-8fca-9ebc1616cf18 tempest-ProjectReaderTests-1916336761 None] Lock "cinder-5c49c57b-99e9-45cc-80b4-c585bc61687f-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-09b0d81e-ee3b-4d2b-975a-a093f097daa9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-09b0d81e-ee3b-4d2b-975a-a093f097daa9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-09b0d81e-ee3b-4d2b-975a-a093f097daa9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-09b0d81e-ee3b-4d2b-975a-a093f097daa9" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fe33f3-b276-4ebc-907d-117d4e4ed631]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:21 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 Sep 02 00:58:21 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:21 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:21 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9 Sep 02 00:58:21 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:22 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-09b0d81e-ee3b-4d2b-975a-a093f097daa9" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-09b0d81e-ee3b-4d2b-975a-a093f097daa9" released by "delete_volume" :: held 0.716s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Created reservations ['7b035ffc-0ba6-4be1-a520-ad1ddfa849f8', 'e01cf19b-1701-4a58-94ab-84fe1507c201', 'bff5f154-86d6-432f-9251-844ec61f8d12', '647e4fb6-2199-43ee-b561-65c0490bf046'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:22 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:22 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:22 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:58:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-88e1ad80-fd56-4550-95cd-39085ec53b8a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-09b0d81e-ee3b-4d2b-975a-a093f097daa9-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (336c2cec-24a7-4d1e-81c0-d10f7f0bc07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7ed62f-fd02-476a-abb2-d780a980f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7ed62f-fd02-476a-abb2-d780a980f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-619354493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e3fc80-f859-4586-8b89-a5b18b9f7987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:23Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b56115-fb47-4d74-b839-49b904b988d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b56115-fb47-4d74-b839-49b904b988d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aba724e-0383-4252-9741-227df1bb6126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aba724e-0383-4252-9741-227df1bb6126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e3fc80-f859-4586-8b89-a5b18b9f7987', 'volume_name': 'volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae171bbe-a955-4c93-acf2-b3d4bc3b79dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae171bbe-a955-4c93-acf2-b3d4bc3b79dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db677f07-5433-4e6c-95d4-be94b696492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Volume c1e3fc80-f859-4586-8b89-a5b18b9f7987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987', 'volume_size': 1} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-619354493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e3fc80-f859-4586-8b89-a5b18b9f7987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:23Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Creating volume c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:23 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 1073741824 Sep 02 00:58:23 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:23 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 1073741824" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:23 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 Sep 02 00:58:23 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:24 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db677f07-5433-4e6c-95d4-be94b696492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0828469f-6c6a-4cdc-92ff-1dccd48b40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Volume volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 (c1e3fc80-f859-4586-8b89-a5b18b9f7987): created successfully Sep 02 00:58:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0828469f-6c6a-4cdc-92ff-1dccd48b40dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (336c2cec-24a7-4d1e-81c0-d10f7f0bc07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-04651115-0018-430a-b055-ce04cf279be9 tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot 7237c318-8c60-4a64-af41-a93219477775 of volume c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Flow 'volume_create_manager' (f4324e63-707e-4532-b76c-b9a56a966e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4964fa17-aad9-4239-bfcb-4d744ad2d8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[76166931-8d63-4e8e-a41c-407381b29c8c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4964fa17-aad9-4239-bfcb-4d744ad2d8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e9509b-72cf-475a-ab88-e717e08e03f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c044b777e84502bc3c304994de2c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:26Z,use_quota=True,user_id='fd9863b7eae34bac9010c6db3c3f8159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9aa105-e386-4f00-84c5-22f8fafa4f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9aa105-e386-4f00-84c5-22f8fafa4f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50009dbf-a9a8-4523-a3cc-914144216bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:25 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 02 00:58:26 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 Sep 02 00:58:26 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50009dbf-a9a8-4523-a3cc-914144216bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0e9509b-72cf-475a-ab88-e717e08e03f0', 'volume_name': 'volume-c0e9509b-72cf-475a-ab88-e717e08e03f0', 'volume_size': 1, 'image_id': 'd431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19fb58d717bc31196c7c731d61644bbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82c044b777e84502bc3c304994de2c06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '700754157b9d3999e83e9c322770d6642d54888874803e49813c9c8267b8a5211d44f0c1475796ac146c5e16ebd3f3852c0c2fad67b6f99c7ca41de42c940d36', 'id': 'd431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'created_at': datetime.datetime(2026, 9, 1, 22, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 58, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb59b13-adac-41c3-b39b-93ec4f8df113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb59b13-adac-41c3-b39b-93ec4f8df113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a81350-5c6c-4608-9e2c-3627c32b30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Volume c0e9509b-72cf-475a-ab88-e717e08e03f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0e9509b-72cf-475a-ab88-e717e08e03f0', 'volume_size': 1, 'image_id': 'd431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19fb58d717bc31196c7c731d61644bbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82c044b777e84502bc3c304994de2c06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '700754157b9d3999e83e9c322770d6642d54888874803e49813c9c8267b8a5211d44f0c1475796ac146c5e16ebd3f3852c0c2fad67b6f99c7ca41de42c940d36', 'id': 'd431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'created_at': datetime.datetime(2026, 9, 1, 22, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 58, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2/file', 'properties': {}}, 'image_service': } Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Trying to clone c0e9509b-72cf-475a-ab88-e717e08e03f0 from image d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 02 00:58:26 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987" returned: 0 in 0.450s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:26 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 1G Sep 02 00:58:26 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 02 00:58:26 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Image download 0.00 MB at 0.00 MB/s Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a894b02-07f1-4c9e-8ca4-346057281c2f]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:26 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD Sep 02 00:58:26 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:26 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 1G" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:26 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:26 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 Sep 02 00:58:26 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:26 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD Sep 02 00:58:26 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:27 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:27 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 is being set with open permissions: ugo+rw Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:27 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 Sep 02 00:58:27 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:27 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Temporary image d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 is fetched for user fd9863b7eae34bac9010c6db3c3f8159. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b285069-f7af-4c2d-9a5a-921e064f96ec]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:27 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD Sep 02 00:58:27 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:27 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775" returned: 0 in 0.281s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:27 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.info Sep 02 00:58:27 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:27 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:27 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.info" returned: 0 in 0.295s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:27 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.info is being set with open permissions: ugo+rw Sep 02 00:58:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:27 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD Sep 02 00:58:27 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:27 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.info Sep 02 00:58:27 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:27 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:28 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.info" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e9509b-72cf-475a-ab88-e717e08e03f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c044b777e84502bc3c304994de2c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:26Z,use_quota=True,user_id='fd9863b7eae34bac9010c6db3c3f8159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Creating volume c0e9509b-72cf-475a-ab88-e717e08e03f0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:28 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:28 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 1073741824 Sep 02 00:58:28 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3a49bcab-00f7-40d3-aef5-1348efcdcca0 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:58:28 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 1073741824" returned: 0 in 0.490s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:28 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 Sep 02 00:58:28 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-7237c318-8c60-4a64-af41-a93219477775-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-7237c318-8c60-4a64-af41-a93219477775-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-c1e3fc80-f859-4586-8b89-a5b18b9f7987" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c1e3fc80-f859-4586-8b89-a5b18b9f7987" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-7237c318-8c60-4a64-af41-a93219477775" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:28 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-7237c318-8c60-4a64-af41-a93219477775" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot 7237c318-8c60-4a64-af41-a93219477775 of volume c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[32094e28-0260-43bd-be68-c8806edb1fc3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Attempting download of d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'metadata': {}}])) to volume c0e9509b-72cf-475a-ab88-e717e08e03f0. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e2359-e817-4978-a9de-e78eaac9aa58]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_16msp2so {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:29 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 Sep 02 00:58:29 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:29 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_16msp2so Sep 02 00:58:29 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:29 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7683a2a-f4be-4565-bb28-d79d1e5053fb]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:29 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_16msp2so" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_16msp2so {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:29 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 Sep 02 00:58:29 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:29 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_16msp2so Sep 02 00:58:29 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:29 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_16msp2so" returned: 1 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_16msp2so' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:58:29 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[feadc7ff-2ef9-40d6-b6db-65d9007ca4ee]: (4, 'raw') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:29 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 Sep 02 00:58:29 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:29 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD Sep 02 00:58:29 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:29 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:29 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:30 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775 Sep 02 00:58:30 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:30 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD Sep 02 00:58:30 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:30 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987.7237c318-8c60-4a64-af41-a93219477775" returned: 0 in 0.243s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-7237c318-8c60-4a64-af41-a93219477775" released by "_delete_snapshot" :: held 1.396s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c1e3fc80-f859-4586-8b89-a5b18b9f7987" released by "delete_snapshot" :: held 1.420s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Created reservations ['5bb1d8a0-319d-4ac3-8d2c-607ebe5c4fd1', 'dea11bc6-4801-4c78-9bcb-8a7fc8139469', '7af97d5d-b920-44e2-87b4-44f04433e8f7', '281f6b51-a03d-4f9d-9fe0-0b8db52f2624'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:30 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:30 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 Sep 02 00:58:30 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3355e484-8c78-4b32-96de-5cf098ccc510 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-7237c318-8c60-4a64-af41-a93219477775-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:30 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0" returned: 0 in 0.433s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d431f255-e189-4c7f-8b72-3ac7b1c4b6f2_gas__fkedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:58:30 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Converted 0.00 MB image at 0.00 MB/s Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:30 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 1G Sep 02 00:58:30 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-c1e3fc80-f859-4586-8b89-a5b18b9f7987-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Lock "cinder-c1e3fc80-f859-4586-8b89-a5b18b9f7987-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-c1e3fc80-f859-4586-8b89-a5b18b9f7987" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c1e3fc80-f859-4586-8b89-a5b18b9f7987" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d3a365-6874-426b-8b76-e3dde674fd85]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:31 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 1G" returned: 0 in 0.360s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Downloaded image d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'metadata': {}}])) to volume c0e9509b-72cf-475a-ab88-e717e08e03f0 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Temporary image d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 for user fd9863b7eae34bac9010c6db3c3f8159 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Marking volume c0e9509b-72cf-475a-ab88-e717e08e03f0 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Copying metadata from image d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 to c0e9509b-72cf-475a-ab88-e717e08e03f0. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Creating volume glance metadata for volume c0e9509b-72cf-475a-ab88-e717e08e03f0 backed by image d431f255-e189-4c7f-8b72-3ac7b1c4b6f2 with: {'image_id': 'd431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '19fb58d717bc31196c7c731d61644bbc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 02 00:58:31 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 Sep 02 00:58:31 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a81350-5c6c-4608-9e2c-3627c32b30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e9509b-72cf-475a-ab88-e717e08e03f0', 'volume_size': 1, 'image_id': 'd431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19fb58d717bc31196c7c731d61644bbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82c044b777e84502bc3c304994de2c06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '700754157b9d3999e83e9c322770d6642d54888874803e49813c9c8267b8a5211d44f0c1475796ac146c5e16ebd3f3852c0c2fad67b6f99c7ca41de42c940d36', 'id': 'd431f255-e189-4c7f-8b72-3ac7b1c4b6f2', 'created_at': datetime.datetime(2026, 9, 1, 22, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 22, 58, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d431f255-e189-4c7f-8b72-3ac7b1c4b6f2/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f79f3c-81c2-4c77-a4f6-0fa89b0e4507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Volume volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 (c0e9509b-72cf-475a-ab88-e717e08e03f0): created successfully Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f79f3c-81c2-4c77-a4f6-0fa89b0e4507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Flow 'volume_create_manager' (f4324e63-707e-4532-b76c-b9a56a966e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-06d1011d-911a-4347-aadb-54b344c3e907 tempest-VolumeImageDependencyTests-1964689303 None] Created volume successfully. Sep 02 00:58:31 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:31 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987 Sep 02 00:58:31 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:31 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c1e3fc80-f859-4586-8b89-a5b18b9f7987" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-c1e3fc80-f859-4586-8b89-a5b18b9f7987" released by "delete_volume" :: held 0.679s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Created reservations ['f7e49123-82db-4542-811b-c01eb7fd567a', 'b009992d-6649-4ad2-a677-e9cc1de19ce5', 'fb6dee85-b291-4523-9a2e-c9df58e5e22d', 'fc023a3a-76e8-4f72-b627-408a0aa42264'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:31 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:31 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:32 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-793948d9-7fb0-4118-9991-96a140f94f3d tempest-ProjectMemberTests-2044355839 None] Lock "cinder-c1e3fc80-f859-4586-8b89-a5b18b9f7987-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Acquiring lock "cinder-c0e9509b-72cf-475a-ab88-e717e08e03f0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Lock "cinder-c0e9509b-72cf-475a-ab88-e717e08e03f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Acquiring lock "cinder-quobyte-c0e9509b-72cf-475a-ab88-e717e08e03f0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Lock "cinder-quobyte-c0e9509b-72cf-475a-ab88-e717e08e03f0" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab783ab-8f8e-49e4-8005-0463c88f3480]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:32 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 Sep 02 00:58:32 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (157e6c88-e402-4c5d-94ae-cdd6a6ec36db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce1bc0c-c7d7-47d4-b34e-836007de77d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce1bc0c-c7d7-47d4-b34e-836007de77d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659343337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eb2243-65e7-4130-858d-ec567327b280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:33Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e143ba-c8a7-4f45-b2ce-68b034a48c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e143ba-c8a7-4f45-b2ce-68b034a48c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2660c1-0bc2-4783-9816-ea01168600d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2660c1-0bc2-4783-9816-ea01168600d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7eb2243-65e7-4130-858d-ec567327b280', 'volume_name': 'volume-d7eb2243-65e7-4130-858d-ec567327b280', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea718e55-9faf-45cf-9ae3-f166e1836156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea718e55-9faf-45cf-9ae3-f166e1836156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb83e1d-94a4-47c7-993a-3f08605111a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Volume d7eb2243-65e7-4130-858d-ec567327b280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7eb2243-65e7-4130-858d-ec567327b280', 'volume_size': 1} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1659343337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eb2243-65e7-4130-858d-ec567327b280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:33Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Creating volume d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:32 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:32 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 1073741824 Sep 02 00:58:32 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:32 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:32 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0 Sep 02 00:58:32 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:33 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-c0e9509b-72cf-475a-ab88-e717e08e03f0" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Lock "cinder-quobyte-c0e9509b-72cf-475a-ab88-e717e08e03f0" released by "delete_volume" :: held 0.746s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Created reservations ['efb69931-d130-41fe-aee1-96bc35a3fd0e', '489ea497-a751-456f-ba2b-c960d1b73850', '9e030ff6-66d3-45cb-9a9d-727f9be13561', '30d4e217-c787-4d9b-a894-5cccb68cacf0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:33 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 1073741824" returned: 0 in 0.428s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:33 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 Sep 02 00:58:33 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:33 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:33 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:33 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280" returned: 0 in 0.287s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb83e1d-94a4-47c7-993a-3f08605111a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7eb2243-65e7-4130-858d-ec567327b280', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:33 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37d3c3c-0b57-4b91-9db5-0e03d812164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Deleted volume successfully. Sep 02 00:58:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Volume volume-d7eb2243-65e7-4130-858d-ec567327b280 (d7eb2243-65e7-4130-858d-ec567327b280): created successfully Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37d3c3c-0b57-4b91-9db5-0e03d812164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (157e6c88-e402-4c5d-94ae-cdd6a6ec36db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c0504013-ab0a-49a5-a570-c399e9886f07 tempest-VolumeImageDependencyTests-1964689303 None] Lock "cinder-c0e9509b-72cf-475a-ab88-e717e08e03f0-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e7ecfffe-b23e-4936-9f82-589bef4f8e27 tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot 41027963-de1e-4675-ab35-83152d5940ab of volume d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8817b874-98e4-48fb-a1c5-e7593c1327de]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:33 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 Sep 02 00:58:33 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:34 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:34 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab 1G Sep 02 00:58:34 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:34 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab 1G" returned: 0 in 0.471s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7eb2243-65e7-4130-858d-ec567327b280 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:34 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7eb2243-65e7-4130-858d-ec567327b280 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab Sep 02 00:58:34 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:35 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7eb2243-65e7-4130-858d-ec567327b280 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:35 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab is being set with open permissions: ugo+rw Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:35 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab Sep 02 00:58:35 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:35 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:35 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.info Sep 02 00:58:35 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:35 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.info" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:35 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.info is being set with open permissions: ugo+rw Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:35 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.info Sep 02 00:58:35 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:35 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.info" returned: 0 in 0.244s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-39a63dd1-18c0-4d4f-874c-918ad7e02670 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-41027963-de1e-4675-ab35-83152d5940ab-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-41027963-de1e-4675-ab35-83152d5940ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-d7eb2243-65e7-4130-858d-ec567327b280" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-d7eb2243-65e7-4130-858d-ec567327b280" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-41027963-de1e-4675-ab35-83152d5940ab" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-41027963-de1e-4675-ab35-83152d5940ab" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot 41027963-de1e-4675-ab35-83152d5940ab of volume d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62e4e36-940a-4ab6-b823-8fa8bd17250a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:37 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab Sep 02 00:58:37 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (c71c1fa8-8486-47f7-9450-460c513d4976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c68d8e2-f768-4c8f-9c9f-4c368a9a67a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c68d8e2-f768-4c8f-9c9f-4c368a9a67a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13408269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe09ca2-db8a-4f29-8ddc-72785b885c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:37Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9683560c-add6-43a3-b907-4a6a7df2dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9683560c-add6-43a3-b907-4a6a7df2dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaee8bf1-9630-46d7-9bda-e39610832152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaee8bf1-9630-46d7-9bda-e39610832152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe09ca2-db8a-4f29-8ddc-72785b885c75', 'volume_name': 'volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc70f5ae-ffe5-4a12-9aa3-2a6b67ebd576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc70f5ae-ffe5-4a12-9aa3-2a6b67ebd576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2845f3a1-0937-4664-8fe3-d667a0e8aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Volume dbe09ca2-db8a-4f29-8ddc-72785b885c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75', 'volume_size': 1} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13408269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe09ca2-db8a-4f29-8ddc-72785b885c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:37Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Creating volume dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:37 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:37 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 1073741824 Sep 02 00:58:37 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:37 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab" returned: 0 in 0.377s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7eb2243-65e7-4130-858d-ec567327b280(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[93482cde-1fa6-41fd-b2b0-436bc174d9c9]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:37 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 Sep 02 00:58:37 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:37 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 1073741824" returned: 0 in 0.439s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:37 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 Sep 02 00:58:37 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:37 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:37 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab Sep 02 00:58:37 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:38 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75" returned: 0 in 0.251s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2845f3a1-0937-4664-8fe3-d667a0e8aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79001ec-b2d0-4e0c-89c1-66a0f9e97e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Volume volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 (dbe09ca2-db8a-4f29-8ddc-72785b885c75): created successfully Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79001ec-b2d0-4e0c-89c1-66a0f9e97e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (c71c1fa8-8486-47f7-9450-460c513d4976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b1ce3618-be45-4c5e-84f4-00ecca1f826b tempest-ProjectReaderTests-222141730 None] Created volume successfully. Sep 02 00:58:38 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:38 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab Sep 02 00:58:38 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Creating offline snapshot d5ee547d-81db-4221-aa8c-6e2a8b48cf3f of volume dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[769ef49b-6704-43b5-8dc6-4fba7fce46c3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:38 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280.41027963-de1e-4675-ab35-83152d5940ab" returned: 0 in 0.285s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:38 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 Sep 02 00:58:38 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-41027963-de1e-4675-ab35-83152d5940ab" released by "_delete_snapshot" :: held 1.510s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-d7eb2243-65e7-4130-858d-ec567327b280" released by "delete_snapshot" :: held 1.540s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Created reservations ['a401acb8-4134-428a-b839-e2d732bc13ad', 'd288fee6-111f-48a0-8fd6-a4b51527fdca', '4bf44a9d-38dc-4656-b69a-8e6910566a38', '86368a3c-c73a-4216-8982-6cb2f81fb304'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-38f080fa-1069-41d7-a196-1bf2ef011c9a tempest-ProjectMemberTests-2044355839 None] Lock "cinder-41027963-de1e-4675-ab35-83152d5940ab-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:38 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:38 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f 1G Sep 02 00:58:38 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-d7eb2243-65e7-4130-858d-ec567327b280-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-d7eb2243-65e7-4130-858d-ec567327b280-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-d7eb2243-65e7-4130-858d-ec567327b280" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:39 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f 1G" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-d7eb2243-65e7-4130-858d-ec567327b280" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:39 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f Sep 02 00:58:39 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a6f74e-a6a8-45c0-9865-715268a6fc6a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:39 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 Sep 02 00:58:39 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:39 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" returned: 0 in 0.299s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:39 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f is being set with open permissions: ugo+rw Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:39 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f Sep 02 00:58:39 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:39 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280" returned: 0 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:39 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280 Sep 02 00:58:39 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:39 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:39 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.info Sep 02 00:58:39 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:39 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d7eb2243-65e7-4130-858d-ec567327b280" returned: 0 in 0.251s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-d7eb2243-65e7-4130-858d-ec567327b280" released by "delete_volume" :: held 0.704s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Created reservations ['665a5b77-b750-4365-b183-4a301df3c1c4', '7dd91c4d-4706-4880-892e-65ba6b1f57e1', 'e7557bd8-c43b-4346-9719-7ed2b2fe2f6e', '07352cbb-6bb1-4aec-bbc5-257ac03dd034'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:40 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.info" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:40 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.info is being set with open permissions: ugo+rw Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:40 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:40 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:40 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.info Sep 02 00:58:40 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:40 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:40 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.263s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.info" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:58:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-12fda6b2-59c2-4e7c-82d0-b45a4223e651 tempest-ProjectReaderTests-222141730 None] Create snapshot completed successfully Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-26496698-c616-494e-9502-32350847db93 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-d7eb2243-65e7-4130-858d-ec567327b280-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-d5ee547d-81db-4221-aa8c-6e2a8b48cf3f-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Lock "cinder-d5ee547d-81db-4221-aa8c-6e2a8b48cf3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-dbe09ca2-db8a-4f29-8ddc-72785b885c75" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-dbe09ca2-db8a-4f29-8ddc-72785b885c75" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Deleting offline snapshot d5ee547d-81db-4221-aa8c-6e2a8b48cf3f of volume dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] snapshot_file for this snap is: volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40eff20-d9c7-4ad8-84b7-2df909ed950b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (0d3194d9-a2a0-4a30-9a37-e8bb0b799c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89dc07f-65a8-4ab5-a43e-9ec04803c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89dc07f-65a8-4ab5-a43e-9ec04803c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117204004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0bbc18-bec3-4886-b404-e56e71c11a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:41Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8ab755-453e-44c2-ab24-c794d0ad5aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8ab755-453e-44c2-ab24-c794d0ad5aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fa3d24-c085-458b-8361-281e10fd27d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fa3d24-c085-458b-8361-281e10fd27d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0bbc18-bec3-4886-b404-e56e71c11a9c', 'volume_name': 'volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:40 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f Sep 02 00:58:40 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9417f88-4fb1-4896-b7cc-5be9916cddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9417f88-4fb1-4896-b7cc-5be9916cddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3e6ee1-1d36-427b-afa9-1fbcbd20961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Volume 6c0bbc18-bec3-4886-b404-e56e71c11a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c', 'volume_size': 1} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117204004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0bbc18-bec3-4886-b404-e56e71c11a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:41Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Creating volume 6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:40 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c 1073741824 Sep 02 00:58:40 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:41 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a204145f-b458-4890-833e-6e781199d46e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:41 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 Sep 02 00:58:41 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:41 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c 1073741824" returned: 0 in 0.428s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:41 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c Sep 02 00:58:41 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:41 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:41 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f Sep 02 00:58:41 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:41 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3e6ee1-1d36-427b-afa9-1fbcbd20961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7662770f-6258-42a6-b59c-9299a93d94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Volume volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c (6c0bbc18-bec3-4886-b404-e56e71c11a9c): created successfully Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7662770f-6258-42a6-b59c-9299a93d94ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (0d3194d9-a2a0-4a30-9a37-e8bb0b799c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-57df725c-7ff1-4d67-9a7d-48b8ee8b230f tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:58:41 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:41 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f Sep 02 00:58:41 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot 8d540518-8c42-4cb1-8df2-f89b4f1a4c7f of volume 6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d58fcf-1450-427d-95af-feb21c0cdb20]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:42 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75.d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:42 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c Sep 02 00:58:42 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d5ee547d-81db-4221-aa8c-6e2a8b48cf3f" released by "_delete_snapshot" :: held 1.468s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-dbe09ca2-db8a-4f29-8ddc-72785b885c75" released by "delete_snapshot" :: held 1.493s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Created reservations ['1b755ca0-65ab-42bc-ae51-0c511b59b4ec', '70f16351-c6c7-4e9a-8dee-ddfae3f7d012', '5849a87b-c4a1-4f4d-9a3d-c6d3dac3ed32', '73937362-aa26-446d-b6d0-18e0ebf834e8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Delete snapshot completed successfully. Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c5786e06-7f08-42ae-bf7c-22ef8886a26a tempest-ProjectReaderTests-222141730 None] Lock "cinder-d5ee547d-81db-4221-aa8c-6e2a8b48cf3f-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:42 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:42 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f 1G Sep 02 00:58:42 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:42 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-dbe09ca2-db8a-4f29-8ddc-72785b885c75-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f 1G" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Lock "cinder-dbe09ca2-db8a-4f29-8ddc-72785b885c75-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:42 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f Sep 02 00:58:42 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-dbe09ca2-db8a-4f29-8ddc-72785b885c75" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-dbe09ca2-db8a-4f29-8ddc-72785b885c75" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e7843-78cd-463e-9a50-943e47ff8c5b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:43 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 Sep 02 00:58:43 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:43 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:43 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f is being set with open permissions: ugo+rw Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:43 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f Sep 02 00:58:43 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:43 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75" returned: 0 in 0.377s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:43 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75 Sep 02 00:58:43 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:43 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:43 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.info Sep 02 00:58:43 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:43 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-dbe09ca2-db8a-4f29-8ddc-72785b885c75" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-dbe09ca2-db8a-4f29-8ddc-72785b885c75" released by "delete_volume" :: held 0.675s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Created reservations ['8c0c64f0-c977-42d8-b82d-7673297f4f2b', '9abb9945-a73e-484e-904a-87fbc50cb2e5', 'a236dfc5-24df-412e-8c88-0f1199c65fc8', '96f79936-5f69-4c92-b698-756f92895e3e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:43 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.info" returned: 0 in 0.279s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:43 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.info is being set with open permissions: ugo+rw Sep 02 00:58:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:43 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:43 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:43 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.info Sep 02 00:58:43 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:44 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:44 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.263s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.info" returned: 0 in 0.255s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Deleted volume successfully. Sep 02 00:58:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4745a90c-bf22-47a4-a5c5-90441ac27272 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-281b5d14-c67d-4d4f-8de7-417835fd4c2e tempest-ProjectReaderTests-222141730 None] Lock "cinder-dbe09ca2-db8a-4f29-8ddc-72785b885c75-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-8d540518-8c42-4cb1-8df2-f89b4f1a4c7f-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-8d540518-8c42-4cb1-8df2-f89b4f1a4c7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-6c0bbc18-bec3-4886-b404-e56e71c11a9c" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-6c0bbc18-bec3-4886-b404-e56e71c11a9c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot 8d540518-8c42-4cb1-8df2-f89b4f1a4c7f of volume 6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae80b4d-6a86-475c-b73c-5eef4411e5a2]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:44 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f Sep 02 00:58:44 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (fa147df2-5b80-4065-af77-d8edbddd472d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d0ba87-ecbd-49fc-b446-6c54e9d05245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d0ba87-ecbd-49fc-b446-6c54e9d05245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011715747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e14c2-f89f-4598-b590-0f9e3f3f2571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:44Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a78eb0-d409-45f7-9333-52eb53c9e4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a78eb0-d409-45f7-9333-52eb53c9e4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d7642e-764f-4b50-9463-defb509f790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d7642e-764f-4b50-9463-defb509f790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22e14c2-f89f-4598-b590-0f9e3f3f2571', 'volume_name': 'volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d4dfb3-1609-44fe-aabe-4f2afb4a633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d4dfb3-1609-44fe-aabe-4f2afb4a633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af53ee5-892b-4a8e-88c9-af4369430a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Volume d22e14c2-f89f-4598-b590-0f9e3f3f2571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571', 'volume_size': 1} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2011715747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22e14c2-f89f-4598-b590-0f9e3f3f2571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:44Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Creating volume d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:44 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:44 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 1073741824 Sep 02 00:58:44 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:44 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21afd6-93df-4e80-b190-724fe65e5937]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:44 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c Sep 02 00:58:44 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:45 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 1073741824" returned: 0 in 0.421s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:45 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 Sep 02 00:58:45 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:45 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:45 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f Sep 02 00:58:45 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:45 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af53ee5-892b-4a8e-88c9-af4369430a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf713e5-65a3-4a5a-abcf-1873f5060e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Volume volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 (d22e14c2-f89f-4598-b590-0f9e3f3f2571): created successfully Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf713e5-65a3-4a5a-abcf-1873f5060e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (fa147df2-5b80-4065-af77-d8edbddd472d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ca4864e1-1d31-4f05-8c74-af01dae553ee tempest-ProjectReaderTests-222141730 None] Created volume successfully. Sep 02 00:58:45 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" returned: 0 in 0.348s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:45 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f Sep 02 00:58:45 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Creating offline snapshot c1311e85-0f20-4ea3-b8a7-76d73d766b8f of volume d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:45 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c.8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1734a3-45c2-4d12-9ce8-bf6fcbf8e3e7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-8d540518-8c42-4cb1-8df2-f89b4f1a4c7f" released by "_delete_snapshot" :: held 1.492s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-6c0bbc18-bec3-4886-b404-e56e71c11a9c" released by "delete_snapshot" :: held 1.522s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Created reservations ['f52c271c-984e-43f6-b455-00c3898ebcc5', 'b187ead5-c406-4590-a068-f9c9930be5b6', '5c7f6f46-2ad0-4a7c-9af9-e4175adf4fe3', '4e277886-a25e-4b9a-8e6f-3fac9f0b31f8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:45 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 Sep 02 00:58:45 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:58:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-648d573e-10f7-4bb4-a71e-be15f28a66f8 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-8d540518-8c42-4cb1-8df2-f89b4f1a4c7f-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:46 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:46 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f 1G Sep 02 00:58:46 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-6c0bbc18-bec3-4886-b404-e56e71c11a9c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-6c0bbc18-bec3-4886-b404-e56e71c11a9c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-6c0bbc18-bec3-4886-b404-e56e71c11a9c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-6c0bbc18-bec3-4886-b404-e56e71c11a9c" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedc29ad-2bbd-439d-8e11-080d044f6620]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:46 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f 1G" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:46 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f Sep 02 00:58:46 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:46 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c Sep 02 00:58:46 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:46 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:46 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f is being set with open permissions: ugo+rw Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:46 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f Sep 02 00:58:46 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:46 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:46 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c Sep 02 00:58:46 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:47 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:47 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.info Sep 02 00:58:47 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:47 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6c0bbc18-bec3-4886-b404-e56e71c11a9c" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-6c0bbc18-bec3-4886-b404-e56e71c11a9c" released by "delete_volume" :: held 0.687s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Created reservations ['161fcb58-4954-4c3f-b911-264a8ddfc9f3', '1c44081c-c12f-4b88-b76c-a7c596823517', '79eda8cf-0a4c-4ce7-b325-c1559676f3b4', '1921ba54-d212-4e1c-9cb9-3d1734b63bba'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:47 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:47 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:47 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.info" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:47 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.info is being set with open permissions: ugo+rw Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:47 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.info Sep 02 00:58:47 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:47 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-08fbbad5-3896-43c6-9ab6-37993d705814 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-6c0bbc18-bec3-4886-b404-e56e71c11a9c-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:47 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.info" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e320dba2-f212-42c4-b2c3-9b35dfcebb13 tempest-ProjectReaderTests-222141730 None] Create snapshot completed successfully Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-c1311e85-0f20-4ea3-b8a7-76d73d766b8f-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Lock "cinder-c1311e85-0f20-4ea3-b8a7-76d73d766b8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-d22e14c2-f89f-4598-b590-0f9e3f3f2571" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d22e14c2-f89f-4598-b590-0f9e3f3f2571" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-c1311e85-0f20-4ea3-b8a7-76d73d766b8f" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-c1311e85-0f20-4ea3-b8a7-76d73d766b8f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Deleting offline snapshot c1311e85-0f20-4ea3-b8a7-76d73d766b8f of volume d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] snapshot_file for this snap is: volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[03273998-3ac8-4ee3-ac7e-16f868c13980]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:48 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f Sep 02 00:58:48 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (0a987665-30d4-4339-b895-7b82b379ecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2800c2e5-51cc-4ea5-9d7f-2b3fb965ca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2800c2e5-51cc-4ea5-9d7f-2b3fb965ca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976782656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5e377d-36cf-4878-874c-ba8c86966225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:48Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abaf30dc-e66c-4dcd-9c0d-1a7f4aaefcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abaf30dc-e66c-4dcd-9c0d-1a7f4aaefcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26eeb05f-3b43-4c52-9669-8d98f8e10219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26eeb05f-3b43-4c52-9669-8d98f8e10219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5e377d-36cf-4878-874c-ba8c86966225', 'volume_name': 'volume-1e5e377d-36cf-4878-874c-ba8c86966225', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4637fc5-d72f-46e5-87bd-8602f1109a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4637fc5-d72f-46e5-87bd-8602f1109a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82e6830-8750-4290-9213-a9f4091e1bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Volume 1e5e377d-36cf-4878-874c-ba8c86966225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5e377d-36cf-4878-874c-ba8c86966225', 'volume_size': 1} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976782656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5e377d-36cf-4878-874c-ba8c86966225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:48Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Creating volume 1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:48 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:48 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 1073741824 Sep 02 00:58:48 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:48 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[36027305-d337-486b-85bd-3c7a1ea21fb3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:48 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 Sep 02 00:58:48 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:48 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 1073741824" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:48 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 Sep 02 00:58:48 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:48 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:48 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f Sep 02 00:58:48 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:48 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225" returned: 0 in 0.242s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82e6830-8750-4290-9213-a9f4091e1bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5e377d-36cf-4878-874c-ba8c86966225', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492d74cf-14fe-4b9a-b9a7-cc7747349ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Volume volume-1e5e377d-36cf-4878-874c-ba8c86966225 (1e5e377d-36cf-4878-874c-ba8c86966225): created successfully Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492d74cf-14fe-4b9a-b9a7-cc7747349ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (0a987665-30d4-4339-b895-7b82b379ecf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5e652b62-419c-4f5e-916a-a31a594ba1f1 tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:58:49 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:49 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f Sep 02 00:58:49 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:49 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571.c1311e85-0f20-4ea3-b8a7-76d73d766b8f" returned: 0 in 0.242s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-c1311e85-0f20-4ea3-b8a7-76d73d766b8f" released by "_delete_snapshot" :: held 1.405s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d22e14c2-f89f-4598-b590-0f9e3f3f2571" released by "delete_snapshot" :: held 1.427s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:49 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Created reservations ['6fc68bed-a65c-4e19-a4d1-6a1b7ed84de2', 'd2a32294-7cd9-414b-9396-2a1d74403527', '8cdc765e-d25e-4db4-9737-b28b1c836372', '0ef02394-ddd3-4a40-9aaa-0715a8047066'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Delete snapshot completed successfully. Sep 02 00:58:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b015fa5-c30f-4f57-9af3-7f3c62ba8994 tempest-ProjectReaderTests-222141730 None] Lock "cinder-c1311e85-0f20-4ea3-b8a7-76d73d766b8f-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-d22e14c2-f89f-4598-b590-0f9e3f3f2571-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Lock "cinder-d22e14c2-f89f-4598-b590-0f9e3f3f2571-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-d22e14c2-f89f-4598-b590-0f9e3f3f2571" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d22e14c2-f89f-4598-b590-0f9e3f3f2571" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb08d53-cd60-45a0-b4c7-16690ce8861d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:50 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 Sep 02 00:58:50 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot 1d8185b2-f65d-4e7f-ac1a-2295a641ccfb of volume 1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185cd78-2f7b-487a-8acf-5ff65f07c0a7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:50 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 Sep 02 00:58:50 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:50 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:50 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571 Sep 02 00:58:50 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:50 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:50 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb 1G Sep 02 00:58:50 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:50 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-d22e14c2-f89f-4598-b590-0f9e3f3f2571" returned: 0 in 0.263s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d22e14c2-f89f-4598-b590-0f9e3f3f2571" released by "delete_volume" :: held 0.701s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Created reservations ['c85e302e-0f95-4417-bf75-b0e78727c503', '35fb1340-e847-46f2-833c-7472de2b6c9c', '7a16133e-13c6-4369-8fa2-42a8f258a48b', '8bac6db8-a750-4f76-bef5-f20e2cb61f38'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:50 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:50 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:51 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb 1G" returned: 0 in 0.425s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5e377d-36cf-4878-874c-ba8c86966225 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:51 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5e377d-36cf-4878-874c-ba8c86966225 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb Sep 02 00:58:51 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:51 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Deleted volume successfully. Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18979fe7-a9b4-4dd7-97e9-60f002d14532 tempest-ProjectReaderTests-222141730 None] Lock "cinder-d22e14c2-f89f-4598-b590-0f9e3f3f2571-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:51 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5e377d-36cf-4878-874c-ba8c86966225 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:51 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb is being set with open permissions: ugo+rw Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:51 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb Sep 02 00:58:51 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (ae836809-d67d-4348-a84c-6b1e4fcbb00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eab2416-9dc8-434e-9c8c-cc440dad2960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eab2416-9dc8-434e-9c8c-cc440dad2960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266482129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edafd55-e4c4-4417-8cd9-bf52eea06f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:52Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0507f383-88c3-42e7-a09b-b07b6ee03353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0507f383-88c3-42e7-a09b-b07b6ee03353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831546a-b2ea-44f2-b0ce-bb2d3732b76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:51 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5831546a-b2ea-44f2-b0ce-bb2d3732b76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6edafd55-e4c4-4417-8cd9-bf52eea06f67', 'volume_name': 'volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fb3ee0-53cf-44d7-9acd-6bc923bc7304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fb3ee0-53cf-44d7-9acd-6bc923bc7304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc072bd-90b0-4cc4-9162-9c8921370f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Volume 6edafd55-e4c4-4417-8cd9-bf52eea06f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67', 'volume_size': 1} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:51 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.info Sep 02 00:58:51 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:52 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.info" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:52 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.info is being set with open permissions: ugo+rw Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:52 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.info Sep 02 00:58:52 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:52 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.info" returned: 0 in 0.235s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266482129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edafd55-e4c4-4417-8cd9-bf52eea06f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:52Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Creating volume 6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:52 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:52 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 1073741824 Sep 02 00:58:52 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8c03e31b-989e-41b3-9631-91d0c83ea6e0 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:58:52 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 1073741824" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:52 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 Sep 02 00:58:52 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:52 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc072bd-90b0-4cc4-9162-9c8921370f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc0a778-c4e5-4279-b6dd-88e4f9a570ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Volume volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 (6edafd55-e4c4-4417-8cd9-bf52eea06f67): created successfully Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc0a778-c4e5-4279-b6dd-88e4f9a570ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (ae836809-d67d-4348-a84c-6b1e4fcbb00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-79a7694b-1c50-4aef-b2bb-4efb50ab8770 tempest-ProjectReaderTests-222141730 None] Created volume successfully. Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-1d8185b2-f65d-4e7f-ac1a-2295a641ccfb-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-1d8185b2-f65d-4e7f-ac1a-2295a641ccfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-1e5e377d-36cf-4878-874c-ba8c86966225" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-1e5e377d-36cf-4878-874c-ba8c86966225" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot 1d8185b2-f65d-4e7f-ac1a-2295a641ccfb of volume 1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[223002f7-e0ee-43f0-9c61-782277ac5aac]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:53 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb Sep 02 00:58:53 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:53 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e5e377d-36cf-4878-874c-ba8c86966225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Creating offline snapshot 52943749-ab99-4fa5-b8c5-0ac3af1a95ee of volume 6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd57e686-0ebf-4497-891d-6e62f4339999]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7541cb0-dd54-47ae-a3e2-035bb26fbad4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:54 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 Sep 02 00:58:54 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:54 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 Sep 02 00:58:54 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:54 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:54 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:54 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb Sep 02 00:58:54 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:54 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee 1G Sep 02 00:58:54 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:54 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:54 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb Sep 02 00:58:54 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:54 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee 1G" returned: 0 in 0.396s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:54 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee Sep 02 00:58:54 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:54 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225.1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-1d8185b2-f65d-4e7f-ac1a-2295a641ccfb" released by "_delete_snapshot" :: held 1.434s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-1e5e377d-36cf-4878-874c-ba8c86966225" released by "delete_snapshot" :: held 1.459s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Created reservations ['72e4fd7f-7c6e-4b7c-a9e7-e995f6bd6db9', '960aa674-18c0-49aa-bfbf-71e42adcbe5d', '9bf7cb3a-f9fc-4989-9752-646f8d3461bc', '69738db9-7ccd-4562-b066-f0c0528546ed'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:55 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:55 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee is being set with open permissions: ugo+rw Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:55 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee Sep 02 00:58:55 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6a2bab1-4391-4f90-b2c4-43f37db356f6 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-1d8185b2-f65d-4e7f-ac1a-2295a641ccfb-delete_snapshot" released by "delete_snapshot" :: held 1.628s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:55 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee" returned: 0 in 0.243s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:55 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.info Sep 02 00:58:55 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:55 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.info" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:55 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.info is being set with open permissions: ugo+rw Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:55 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.info Sep 02 00:58:55 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-1e5e377d-36cf-4878-874c-ba8c86966225-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-1e5e377d-36cf-4878-874c-ba8c86966225-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-1e5e377d-36cf-4878-874c-ba8c86966225" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-1e5e377d-36cf-4878-874c-ba8c86966225" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a648a6ee-997a-418b-9e1e-c6313cb52052]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:55 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.info" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:55 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 Sep 02 00:58:55 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-77b2175d-da3c-44f3-b819-b283aff5408a tempest-ProjectReaderTests-222141730 None] Create snapshot completed successfully Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-52943749-ab99-4fa5-b8c5-0ac3af1a95ee-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Lock "cinder-52943749-ab99-4fa5-b8c5-0ac3af1a95ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-6edafd55-e4c4-4417-8cd9-bf52eea06f67" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-6edafd55-e4c4-4417-8cd9-bf52eea06f67" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-52943749-ab99-4fa5-b8c5-0ac3af1a95ee" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-52943749-ab99-4fa5-b8c5-0ac3af1a95ee" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Deleting offline snapshot 52943749-ab99-4fa5-b8c5-0ac3af1a95ee of volume 6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:58:56 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] snapshot_file for this snap is: volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225" returned: 0 in 0.384s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42f14e0-bbbc-4a8b-bfaf-d8de6fdcafc3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:56 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225 Sep 02 00:58:56 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:56 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee Sep 02 00:58:56 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:56 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-1e5e377d-36cf-4878-874c-ba8c86966225" returned: 0 in 0.242s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-1e5e377d-36cf-4878-874c-ba8c86966225" released by "delete_volume" :: held 0.676s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Created reservations ['82070eb8-50da-4820-816a-0d6297f4fbf5', '1c1f0a0a-6771-405a-be01-f83672c731d7', '114635fe-d73f-42f2-bb96-243e7b6a9aa3', 'a35b4686-4654-40b0-b4d6-bb590a268ce1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:56 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec11cd2-a07e-48e2-a9ee-e9dca4df505a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:56 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:56 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:56 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 Sep 02 00:58:56 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:56 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.244s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-afa9a5d9-3d4a-49be-bafa-590a6cfb5d23 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-1e5e377d-36cf-4878-874c-ba8c86966225-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:56 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:56 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee Sep 02 00:58:56 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:57 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (9e46e2eb-f556-4f17-8bcd-11fd1422dc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0890a9a7-e61a-4ee7-80f8-f2454bb54dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:57 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee Sep 02 00:58:57 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0890a9a7-e61a-4ee7-80f8-f2454bb54dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988744308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00163fbb-fe7b-42d3-91a7-50525c2bf3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:57Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de843f-687a-4fde-a6a3-e6037b353547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de843f-687a-4fde-a6a3-e6037b353547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3371f381-45b8-4343-b37a-033a05aebb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3371f381-45b8-4343-b37a-033a05aebb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00163fbb-fe7b-42d3-91a7-50525c2bf3d1', 'volume_name': 'volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ed7293-1b72-41bd-9041-e23d36d7b693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ed7293-1b72-41bd-9041-e23d36d7b693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258f3724-344a-46a7-95fa-3a3851c8b40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Volume 00163fbb-fe7b-42d3-91a7-50525c2bf3d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1', 'volume_size': 1} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1988744308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00163fbb-fe7b-42d3-91a7-50525c2bf3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:58:57Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Creating volume 00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:58:57 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:57 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 1073741824 Sep 02 00:58:57 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:57 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67.52943749-ab99-4fa5-b8c5-0ac3af1a95ee" returned: 0 in 0.243s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-52943749-ab99-4fa5-b8c5-0ac3af1a95ee" released by "_delete_snapshot" :: held 1.459s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-6edafd55-e4c4-4417-8cd9-bf52eea06f67" released by "delete_snapshot" :: held 1.478s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Created reservations ['340d588c-2ae4-4828-8cba-21cf56d7bbf2', 'c252c9f9-6cf5-4043-bfbf-a7d4becc8a0d', '0cebb3e8-18d8-40de-bb5f-57c53a898cfc', '8a2dd1bf-7402-44c4-9c49-667e54f1b710'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Delete snapshot completed successfully. Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-561e0ce4-9220-4936-9d36-7f649de20a8e tempest-ProjectReaderTests-222141730 None] Lock "cinder-52943749-ab99-4fa5-b8c5-0ac3af1a95ee-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:57 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 1073741824" returned: 0 in 0.425s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:57 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 Sep 02 00:58:57 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:58 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258f3724-344a-46a7-95fa-3a3851c8b40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b8d60b-46a5-4a2e-bc02-6fbd11ef2c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Volume volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 (00163fbb-fe7b-42d3-91a7-50525c2bf3d1): created successfully Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b8d60b-46a5-4a2e-bc02-6fbd11ef2c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (9e46e2eb-f556-4f17-8bcd-11fd1422dc58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-aec92de2-3360-49a0-a896-d6c9b62010e8 tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-6edafd55-e4c4-4417-8cd9-bf52eea06f67-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Lock "cinder-6edafd55-e4c4-4417-8cd9-bf52eea06f67-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-6edafd55-e4c4-4417-8cd9-bf52eea06f67" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-6edafd55-e4c4-4417-8cd9-bf52eea06f67" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda88ddd-0018-4984-9096-a7a9ce2442a3]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:58 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 Sep 02 00:58:58 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot b7836e63-f941-42b8-9607-4bcc4ac5b6dd of volume 00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d2dcf3-9058-4b0c-b954-e4a0fbd49cff]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:58 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 Sep 02 00:58:58 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:58 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67" returned: 0 in 0.376s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:58 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67 Sep 02 00:58:58 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:58 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" returned: 0 in 0.353s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:58 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd 1G Sep 02 00:58:58 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:58 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-6edafd55-e4c4-4417-8cd9-bf52eea06f67" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-6edafd55-e4c4-4417-8cd9-bf52eea06f67" released by "delete_volume" :: held 0.699s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Created reservations ['c7a14dfc-bcb3-4d9e-b500-94b51d653891', '9af19537-5037-4b41-8186-6375738ae1bd', '97b568d7-f66c-43fb-94bb-ab324a2be032', 'a04fb6a5-3b97-4216-b23c-f8efeafe89fa'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:59 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:58:59 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:59 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd 1G" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:59 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd Sep 02 00:58:59 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:59 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.263s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:58:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Deleted volume successfully. Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-04c69d8d-0d07-4eca-889d-d72b38127d31 tempest-ProjectReaderTests-222141730 None] Lock "cinder-6edafd55-e4c4-4417-8cd9-bf52eea06f67-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:58:59 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:59 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd is being set with open permissions: ugo+rw Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:59 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd Sep 02 00:58:59 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:58:59 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (35f5a8dd-2134-4501-a6af-a302d404061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd0dcd4-7c8b-43a0-88f4-1dc81eed1a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd0dcd4-7c8b-43a0-88f4-1dc81eed1a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321809735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c38793-4d2a-4e77-9e29-124202d0e493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:00Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99235e9d-4332-4601-b854-be7049ec31c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99235e9d-4332-4601-b854-be7049ec31c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9875ae21-efa6-4d06-9aa6-d643e1d38d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9875ae21-efa6-4d06-9aa6-d643e1d38d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c38793-4d2a-4e77-9e29-124202d0e493', 'volume_name': 'volume-30c38793-4d2a-4e77-9e29-124202d0e493', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9595b2-0a38-4801-8bcd-f7743c680fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9595b2-0a38-4801-8bcd-f7743c680fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be05349f-2d69-4f1f-b42d-39b8cb635d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:58:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Volume 30c38793-4d2a-4e77-9e29-124202d0e493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c38793-4d2a-4e77-9e29-124202d0e493', 'volume_size': 1} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:58:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:58:59 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.info Sep 02 00:58:59 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:00 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.info" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:00 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.info is being set with open permissions: ugo+rw Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:00 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.info Sep 02 00:59:00 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:00 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.info" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1321809735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c38793-4d2a-4e77-9e29-124202d0e493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:00Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Creating volume 30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:59:00 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:00 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 1073741824 Sep 02 00:59:00 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6e2cfe24-23fb-4f98-ba76-a7d8553099ab tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:59:00 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 1073741824" returned: 0 in 0.430s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:00 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 Sep 02 00:59:00 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:01 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be05349f-2d69-4f1f-b42d-39b8cb635d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c38793-4d2a-4e77-9e29-124202d0e493', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9120d781-ba16-4dfa-8a90-5edda03617e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Volume volume-30c38793-4d2a-4e77-9e29-124202d0e493 (30c38793-4d2a-4e77-9e29-124202d0e493): created successfully Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9120d781-ba16-4dfa-8a90-5edda03617e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (35f5a8dd-2134-4501-a6af-a302d404061b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4e32a9da-658e-4ecb-aa03-2783c94d07f0 tempest-ProjectReaderTests-222141730 None] Created volume successfully. Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-b7836e63-f941-42b8-9607-4bcc4ac5b6dd-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-b7836e63-f941-42b8-9607-4bcc4ac5b6dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-b7836e63-f941-42b8-9607-4bcc4ac5b6dd" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-b7836e63-f941-42b8-9607-4bcc4ac5b6dd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot b7836e63-f941-42b8-9607-4bcc4ac5b6dd of volume 00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[110391a3-2ff5-4129-8041-0b963f5b635d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:01 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd Sep 02 00:59:01 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Creating offline snapshot d6d82f90-430c-49ac-8bab-28ad5b09bee4 of volume 30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[19805d90-b549-4515-bb8d-6ddd30f776c0]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:02 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2f66f7-ac92-4345-8184-918e423b8cf4]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:02 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 Sep 02 00:59:02 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:02 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 Sep 02 00:59:02 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:02 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:02 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:02 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 1G Sep 02 00:59:02 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:02 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd Sep 02 00:59:02 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:02 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:02 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd Sep 02 00:59:02 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:02 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 1G" returned: 0 in 0.399s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c38793-4d2a-4e77-9e29-124202d0e493 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:02 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c38793-4d2a-4e77-9e29-124202d0e493 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 Sep 02 00:59:02 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:03 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1.b7836e63-f941-42b8-9607-4bcc4ac5b6dd" returned: 0 in 0.250s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-b7836e63-f941-42b8-9607-4bcc4ac5b6dd" released by "_delete_snapshot" :: held 1.421s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" released by "delete_snapshot" :: held 1.444s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:03 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30c38793-4d2a-4e77-9e29-124202d0e493 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:03 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 is being set with open permissions: ugo+rw Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Created reservations ['4bd51379-26f8-4222-ab97-75bd883bf6d9', '83876fab-7614-41ed-b0cb-e0d2df6cad46', '2cb28cee-c81d-40e1-a08b-8986c1b99a57', '45e0d1e2-f5cd-4e38-97ff-d3ff46e732b3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:03 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 Sep 02 00:59:03 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b582ad0-1750-4611-abce-bdf5f5b862c5 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-b7836e63-f941-42b8-9607-4bcc4ac5b6dd-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:03 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:03 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.info Sep 02 00:59:03 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:03 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.info" returned: 0 in 0.243s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:03 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.info is being set with open permissions: ugo+rw Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:03 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.info Sep 02 00:59:03 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-00163fbb-fe7b-42d3-91a7-50525c2bf3d1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-00163fbb-fe7b-42d3-91a7-50525c2bf3d1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:03 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.info" returned: 0 in 0.247s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dba77cb-5408-42f8-a6a0-2cfb6f8b2268]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5b0ffdac-c091-4e6b-b11e-57337e20834e tempest-ProjectReaderTests-222141730 None] Create snapshot completed successfully Sep 02 00:59:04 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 Sep 02 00:59:04 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-d6d82f90-430c-49ac-8bab-28ad5b09bee4-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Lock "cinder-d6d82f90-430c-49ac-8bab-28ad5b09bee4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-30c38793-4d2a-4e77-9e29-124202d0e493" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-30c38793-4d2a-4e77-9e29-124202d0e493" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-d6d82f90-430c-49ac-8bab-28ad5b09bee4" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d6d82f90-430c-49ac-8bab-28ad5b09bee4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Deleting offline snapshot d6d82f90-430c-49ac-8bab-28ad5b09bee4 of volume 30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] snapshot_file for this snap is: volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a604c5a-dca1-4e9b-95cf-fa7fa0c9c575]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:04 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" returned: 0 in 0.376s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:04 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1 Sep 02 00:59:04 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:04 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 Sep 02 00:59:04 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:04 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" returned: 0 in 0.264s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-00163fbb-fe7b-42d3-91a7-50525c2bf3d1" released by "delete_volume" :: held 0.716s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Created reservations ['a9949146-267b-473c-8563-e8b628294037', 'aaac6204-0ca1-4283-b72c-9fc6c5192ebd', '6ee2aa39-68e9-401d-af69-f3bad5c2810a', '500f1cb7-9887-47ba-95fd-48e9b1b99baf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:04 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4" returned: 0 in 0.384s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30c38793-4d2a-4e77-9e29-124202d0e493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8315e99-06b9-4a86-b92f-12d7f7f9e2c5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:04 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:59:04 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:04 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 Sep 02 00:59:04 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:05 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:59:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6b834874-0d0e-44d6-a0b7-d4c2372cc377 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-00163fbb-fe7b-42d3-91a7-50525c2bf3d1-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:05 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:05 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 Sep 02 00:59:05 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:59:05 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (f982885d-d7ff-437e-b7b4-d9efa9b45834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94efd5f5-37c6-4911-8620-f6da064b6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4" returned: 0 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94efd5f5-37c6-4911-8620-f6da064b6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506188204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548a14ee-05ad-4fea-94cb-c7a8c8096667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:05Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:05 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4 Sep 02 00:59:05 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe4cdd0-1381-47f5-afa9-c3436f2a1208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe4cdd0-1381-47f5-afa9-c3436f2a1208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1737bdc-ee9a-4dce-999c-24c709ec71b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1737bdc-ee9a-4dce-999c-24c709ec71b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548a14ee-05ad-4fea-94cb-c7a8c8096667', 'volume_name': 'volume-548a14ee-05ad-4fea-94cb-c7a8c8096667', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e79823-e09d-49b7-9dd8-e0aeec7134f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e79823-e09d-49b7-9dd8-e0aeec7134f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45a8af-c195-42bc-b510-8c3dfd2f662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Volume 548a14ee-05ad-4fea-94cb-c7a8c8096667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548a14ee-05ad-4fea-94cb-c7a8c8096667', 'volume_size': 1} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506188204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548a14ee-05ad-4fea-94cb-c7a8c8096667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:05Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Creating volume 548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:59:05 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:05 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 1073741824 Sep 02 00:59:05 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:05 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493.d6d82f90-430c-49ac-8bab-28ad5b09bee4" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-d6d82f90-430c-49ac-8bab-28ad5b09bee4" released by "_delete_snapshot" :: held 1.503s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-30c38793-4d2a-4e77-9e29-124202d0e493" released by "delete_snapshot" :: held 1.530s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Created reservations ['1bf5ed8d-5c0e-4836-a232-38cf5a86dfb3', '06386340-14ee-438f-9c3c-6d0d636d9871', 'ff792973-020d-416d-b4aa-00931ee1db59', '0c49fb0a-5af1-40b3-a0b3-4dee67ad3bf0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Delete snapshot completed successfully. Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c4465067-82fa-4459-8052-473cfeeae239 tempest-ProjectReaderTests-222141730 None] Lock "cinder-d6d82f90-430c-49ac-8bab-28ad5b09bee4-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:05 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 1073741824" returned: 0 in 0.440s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:06 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 Sep 02 00:59:06 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:06 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667" returned: 0 in 0.238s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45a8af-c195-42bc-b510-8c3dfd2f662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548a14ee-05ad-4fea-94cb-c7a8c8096667', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd6f9ef-61ae-4faa-9d6d-bac1a6bce6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Volume volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 (548a14ee-05ad-4fea-94cb-c7a8c8096667): created successfully Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd6f9ef-61ae-4faa-9d6d-bac1a6bce6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (f982885d-d7ff-437e-b7b4-d9efa9b45834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7cae837f-8a90-41be-b369-f5a27ebce60d tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-30c38793-4d2a-4e77-9e29-124202d0e493-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Lock "cinder-30c38793-4d2a-4e77-9e29-124202d0e493-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-30c38793-4d2a-4e77-9e29-124202d0e493" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-30c38793-4d2a-4e77-9e29-124202d0e493" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f365935-4da6-4a95-8493-30f347a7e169]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:06 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 Sep 02 00:59:06 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 of volume 548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[28805dfd-c78b-43f7-854f-8b62e849cecf]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:06 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 Sep 02 00:59:06 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:06 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:06 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493 Sep 02 00:59:06 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:07 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:07 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 1G Sep 02 00:59:07 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:07 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-30c38793-4d2a-4e77-9e29-124202d0e493" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-30c38793-4d2a-4e77-9e29-124202d0e493" released by "delete_volume" :: held 0.686s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Created reservations ['e4f7c92f-00bc-4700-a3d1-8650322eb923', '8eab251b-94ad-40b0-982f-1652fa4ff3d7', '73f6658a-f8a3-4d0d-b252-ee083be3f87b', '14389292-a0f6-42d2-8d16-c1a002af1ab6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:07 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:59:07 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:07 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 1G" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:07 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 Sep 02 00:59:07 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:07 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:59:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Deleted volume successfully. Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e07c651b-6948-4c72-affe-fc935eca35cd tempest-ProjectReaderTests-222141730 None] Lock "cinder-30c38793-4d2a-4e77-9e29-124202d0e493-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:07 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" returned: 0 in 0.324s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:07 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 is being set with open permissions: ugo+rw Sep 02 00:59:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:07 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 Sep 02 00:59:07 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:08 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (15502d69-8ed3-4759-97d3-7e13f1a29b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4c7899-7ccb-4125-b38f-723f37dff881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4c7899-7ccb-4125-b38f-723f37dff881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064095700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bc0404-20df-42f9-b11d-391e6331f2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:08Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fb72e5-6c9c-490a-b6ec-f9c7cf341f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fb72e5-6c9c-490a-b6ec-f9c7cf341f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d7530d-2517-4f14-961f-d234102d310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d7530d-2517-4f14-961f-d234102d310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11bc0404-20df-42f9-b11d-391e6331f2d0', 'volume_name': 'volume-11bc0404-20df-42f9-b11d-391e6331f2d0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f1ee78-394c-43d0-a7d0-ca232d2dfb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f1ee78-394c-43d0-a7d0-ca232d2dfb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180f5963-4539-45b9-b6f2-8770d20556dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Volume 11bc0404-20df-42f9-b11d-391e6331f2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11bc0404-20df-42f9-b11d-391e6331f2d0', 'volume_size': 1} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:08 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.info Sep 02 00:59:08 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:08 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.info" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:08 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.info is being set with open permissions: ugo+rw Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:08 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.info Sep 02 00:59:08 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:08 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.info" returned: 0 in 0.251s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064095700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11bc0404-20df-42f9-b11d-391e6331f2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc5451d68446f7843a8987e8823407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:08Z,use_quota=True,user_id='e26196037cdd4e40ba54a14cc5c4a9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Creating volume 11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:59:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:59:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:08 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 1073741824 Sep 02 00:59:08 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f7547bbb-7163-4175-b3fb-a3b289fbb0c0 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:59:09 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 1073741824" returned: 0 in 0.410s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:09 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 Sep 02 00:59:09 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:09 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0" returned: 0 in 0.238s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180f5963-4539-45b9-b6f2-8770d20556dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11bc0404-20df-42f9-b11d-391e6331f2d0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d8ba22-b7d1-4863-ab10-0fe12b831af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Volume volume-11bc0404-20df-42f9-b11d-391e6331f2d0 (11bc0404-20df-42f9-b11d-391e6331f2d0): created successfully Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d8ba22-b7d1-4863-ab10-0fe12b831af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Flow 'volume_create_manager' (15502d69-8ed3-4759-97d3-7e13f1a29b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d4ca6738-9444-4220-8c75-a266e367ccce tempest-ProjectReaderTests-222141730 None] Created volume successfully. Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-cdf1a4ab-80a6-41b4-aeb4-9e77aab85604-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Lock "cinder-cdf1a4ab-80a6-41b4-aeb4-9e77aab85604-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-548a14ee-05ad-4fea-94cb-c7a8c8096667" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-548a14ee-05ad-4fea-94cb-c7a8c8096667" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 of volume 548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98bc265-3f7f-4bfe-9d48-4563e3a88da5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:09 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 Sep 02 00:59:09 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Creating offline snapshot 4b3ea8bf-74eb-498d-ac11-ac7b9695860c of volume 11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:59:10 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" returned: 0 in 0.391s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-548a14ee-05ad-4fea-94cb-c7a8c8096667(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[308a5832-8831-4d2f-be6d-51a21551c194]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dff07f4-211a-474b-9538-8cdc4826a1c6]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:10 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 Sep 02 00:59:10 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:10 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 Sep 02 00:59:10 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:10 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:10 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:10 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 Sep 02 00:59:10 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:10 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c 1G Sep 02 00:59:10 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:10 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:11 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604 Sep 02 00:59:11 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:11 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c 1G" returned: 0 in 0.400s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bc0404-20df-42f9-b11d-391e6331f2d0 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:11 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bc0404-20df-42f9-b11d-391e6331f2d0 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c Sep 02 00:59:11 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:11 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667.cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-cdf1a4ab-80a6-41b4-aeb4-9e77aab85604" released by "_delete_snapshot" :: held 1.441s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-548a14ee-05ad-4fea-94cb-c7a8c8096667" released by "delete_snapshot" :: held 1.463s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:11 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11bc0404-20df-42f9-b11d-391e6331f2d0 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c" returned: 0 in 0.290s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:11 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c is being set with open permissions: ugo+rw Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Created reservations ['52f255ff-b94b-4749-bd0e-b4d4988f358f', 'dc267c15-b96d-406d-9dff-4123864d91cc', '5669e42f-e8c2-4df1-9910-3ff927eb71d0', '0a659167-9c7e-486f-a029-24cc0447e22b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:11 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c Sep 02 00:59:11 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cc0c6ee-2ded-4b3e-88b1-9fb875884eef tempest-ProjectMemberTests-2044355839 None] Lock "cinder-cdf1a4ab-80a6-41b4-aeb4-9e77aab85604-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:11 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c" returned: 0 in 0.252s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:11 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.info Sep 02 00:59:11 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:11 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.info" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:11 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.info is being set with open permissions: ugo+rw Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:11 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.info Sep 02 00:59:11 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-548a14ee-05ad-4fea-94cb-c7a8c8096667-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Lock "cinder-548a14ee-05ad-4fea-94cb-c7a8c8096667-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-548a14ee-05ad-4fea-94cb-c7a8c8096667" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-548a14ee-05ad-4fea-94cb-c7a8c8096667" acquired by "delete_volume" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5098420a-d008-47cd-8b0a-6905e279fd74]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:12 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.info" returned: 0 in 0.250s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c5cf993c-a558-4eec-89e6-eaf5e2664c39 tempest-ProjectReaderTests-222141730 None] Create snapshot completed successfully Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:59:12 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:12 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:12 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:59:12 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-4b3ea8bf-74eb-498d-ac11-ac7b9695860c-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Lock "cinder-4b3ea8bf-74eb-498d-ac11-ac7b9695860c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-11bc0404-20df-42f9-b11d-391e6331f2d0" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-11bc0404-20df-42f9-b11d-391e6331f2d0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-4b3ea8bf-74eb-498d-ac11-ac7b9695860c" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-4b3ea8bf-74eb-498d-ac11-ac7b9695860c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:12 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Deleting offline snapshot 4b3ea8bf-74eb-498d-ac11-ac7b9695860c of volume 11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] snapshot_file for this snap is: volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 00:59:12 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a411451b-8ed7-4404-b960-a21aa08afd45]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:12 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667 Sep 02 00:59:12 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:12 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c Sep 02 00:59:12 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:12 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-548a14ee-05ad-4fea-94cb-c7a8c8096667" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-548a14ee-05ad-4fea-94cb-c7a8c8096667" released by "delete_volume" :: held 0.732s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Created reservations ['d0dcb761-ff98-4272-8189-97d9664c610b', '9da17412-f892-4c37-9c04-491e1f074725', 'e78f8cd9-ab22-438d-b0f5-bbf9436f3ccb', '92f53637-aabc-4780-af74-9095f4e3ff64'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:12 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11bc0404-20df-42f9-b11d-391e6331f2d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f521cd29-c99e-4ba4-8510-dcc50c0a0d8d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:12 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:59:12 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:13 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 Sep 02 00:59:13 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:13 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.251s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:59:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a798ec44-653f-4053-8482-f93d388bc8af tempest-ProjectMemberTests-2044355839 None] Lock "cinder-548a14ee-05ad-4fea-94cb-c7a8c8096667-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:13 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:13 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c Sep 02 00:59:13 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (3b4e045d-01bf-493d-879d-a2d303b79838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624eac77-ecca-40aa-ae61-2163d7ea72d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624eac77-ecca-40aa-ae61-2163d7ea72d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682575830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530a58cc-1182-4026-ac09-8f2ed7affff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:14Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c37a6dd-4210-4276-8203-9b6b13569b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c37a6dd-4210-4276-8203-9b6b13569b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7069b4-8f31-4c98-9046-152a90a93a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7069b4-8f31-4c98-9046-152a90a93a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530a58cc-1182-4026-ac09-8f2ed7affff5', 'volume_name': 'volume-530a58cc-1182-4026-ac09-8f2ed7affff5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7025566c-9294-4d92-8680-158e507e06e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7025566c-9294-4d92-8680-158e507e06e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa5eb03-57d9-4933-8dc5-a803f6198ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Volume 530a58cc-1182-4026-ac09-8f2ed7affff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530a58cc-1182-4026-ac09-8f2ed7affff5', 'volume_size': 1} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682575830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530a58cc-1182-4026-ac09-8f2ed7affff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d115c3d9414b01998faef9d89da81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:14Z,use_quota=True,user_id='a4433d603511424ab0b56b5b98bef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Creating volume 530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:13 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:59:13 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:13 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 1073741824 Sep 02 00:59:13 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:13 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c Sep 02 00:59:13 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:13 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0.4b3ea8bf-74eb-498d-ac11-ac7b9695860c" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-4b3ea8bf-74eb-498d-ac11-ac7b9695860c" released by "_delete_snapshot" :: held 1.500s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-11bc0404-20df-42f9-b11d-391e6331f2d0" released by "delete_snapshot" :: held 1.522s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Created reservations ['b805f7e2-7f0b-4d6a-a081-4023431237c5', 'e85ce7e9-727d-4feb-aa1b-2eb6499101d6', '040cdf49-a572-4fa7-ac8d-f704838f2dc5', '6e507456-6f47-4cbe-8269-c2b90c159309'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:14 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 1073741824" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Delete snapshot completed successfully. Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64166ca1-f79f-4f79-a064-41cca89fa711 tempest-ProjectReaderTests-222141730 None] Lock "cinder-4b3ea8bf-74eb-498d-ac11-ac7b9695860c-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:14 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 Sep 02 00:59:14 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:14 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa5eb03-57d9-4933-8dc5-a803f6198ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530a58cc-1182-4026-ac09-8f2ed7affff5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2597ef1-ac9a-4d12-a23a-c13d5559911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Volume volume-530a58cc-1182-4026-ac09-8f2ed7affff5 (530a58cc-1182-4026-ac09-8f2ed7affff5): created successfully Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2597ef1-ac9a-4d12-a23a-c13d5559911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Flow 'volume_create_manager' (3b4e045d-01bf-493d-879d-a2d303b79838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e44c705c-b95f-45eb-870e-36f11da07aa2 tempest-ProjectMemberTests-2044355839 None] Created volume successfully. Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-11bc0404-20df-42f9-b11d-391e6331f2d0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Lock "cinder-11bc0404-20df-42f9-b11d-391e6331f2d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Acquiring lock "cinder-quobyte-11bc0404-20df-42f9-b11d-391e6331f2d0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-11bc0404-20df-42f9-b11d-391e6331f2d0" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b3b604-7a04-4b9d-b4dd-2a44a1b25c1c]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Creating offline snapshot 753a4cb0-6bec-4cb3-9158-1a6318b49d79 of volume 530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[48552b0b-d71f-42b3-9e31-d7bb3bf6825a]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:14 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 Sep 02 00:59:14 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:14 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 Sep 02 00:59:14 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:15 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:15 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0 Sep 02 00:59:15 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:15 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:15 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 1G Sep 02 00:59:15 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:15 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-11bc0404-20df-42f9-b11d-391e6331f2d0" returned: 0 in 0.244s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Lock "cinder-quobyte-11bc0404-20df-42f9-b11d-391e6331f2d0" released by "delete_volume" :: held 0.691s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Created reservations ['059e46b9-6ced-46d4-931b-4e0a99143637', '1f03a062-5664-415c-879e-987f8299a38a', '7600bf42-ffe8-4e6c-896d-c6df6b7fc874', '939ae56a-4a46-4dab-a9d4-d44ece4f37c0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:15 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:59:15 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:15 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 1G" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-530a58cc-1182-4026-ac09-8f2ed7affff5 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:15 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-530a58cc-1182-4026-ac09-8f2ed7affff5 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 Sep 02 00:59:15 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:15 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:59:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Deleted volume successfully. Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4601f9f0-1a62-4b92-9ade-97863279ed06 tempest-ProjectReaderTests-222141730 None] Lock "cinder-11bc0404-20df-42f9-b11d-391e6331f2d0-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:15 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-530a58cc-1182-4026-ac09-8f2ed7affff5 -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:15 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 is being set with open permissions: ugo+rw Sep 02 00:59:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:15 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 Sep 02 00:59:15 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:16 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:16 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.info Sep 02 00:59:16 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:16 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.info" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:16 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.info is being set with open permissions: ugo+rw Sep 02 00:59:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:16 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.info Sep 02 00:59:16 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:16 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.info" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e792e77e-e3ab-4a44-9320-dc1e7f47fc93 tempest-ProjectMemberTests-2044355839 None] Create snapshot completed successfully Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-753a4cb0-6bec-4cb3-9158-1a6318b49d79-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-753a4cb0-6bec-4cb3-9158-1a6318b49d79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-530a58cc-1182-4026-ac09-8f2ed7affff5" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-530a58cc-1182-4026-ac09-8f2ed7affff5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-753a4cb0-6bec-4cb3-9158-1a6318b49d79" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-753a4cb0-6bec-4cb3-9158-1a6318b49d79" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Deleting offline snapshot 753a4cb0-6bec-4cb3-9158-1a6318b49d79 of volume 530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] snapshot_file for this snap is: volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe5c702-7bb9-43b3-847b-b8f76da80dce]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:17 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 Sep 02 00:59:17 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:17 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-530a58cc-1182-4026-ac09-8f2ed7affff5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6101c51-b96d-4d97-b89f-2eb0b4d6efd5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:17 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 Sep 02 00:59:17 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:17 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:17 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 Sep 02 00:59:17 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:18 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:18 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79 Sep 02 00:59:18 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:18 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5.753a4cb0-6bec-4cb3-9158-1a6318b49d79" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-753a4cb0-6bec-4cb3-9158-1a6318b49d79" released by "_delete_snapshot" :: held 1.446s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-530a58cc-1182-4026-ac09-8f2ed7affff5" released by "delete_snapshot" :: held 1.471s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=196,cinder:UPDATE=226,cinder:INSERT=74,cinder:DELETE=24 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:DELETE=17,cinder:UPDATE=253,cinder:SELECT=182,cinder:INSERT=65 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Created reservations ['a06c56d4-4037-4b46-b81d-1a7e961f75cd', 'e2f10bcc-ccf0-4ab2-a827-d5da7c41ca6b', 'bd11f8ea-6d4c-4173-8436-d88a13e5f34a', 'd17711b0-1444-4a8d-8787-980cda291e6b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Delete snapshot completed successfully. Sep 02 00:59:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-657fb686-fa42-44e6-9beb-ba7c5d813527 tempest-ProjectMemberTests-2044355839 None] Lock "cinder-753a4cb0-6bec-4cb3-9158-1a6318b49d79-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-530a58cc-1182-4026-ac09-8f2ed7affff5-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Lock "cinder-530a58cc-1182-4026-ac09-8f2ed7affff5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Acquiring lock "cinder-quobyte-530a58cc-1182-4026-ac09-8f2ed7affff5" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-530a58cc-1182-4026-ac09-8f2ed7affff5" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4753fea-fa1c-4ccd-b574-76e638148fa5]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:19 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 Sep 02 00:59:19 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:19 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:19 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5 Sep 02 00:59:19 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:19 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-530a58cc-1182-4026-ac09-8f2ed7affff5" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Lock "cinder-quobyte-530a58cc-1182-4026-ac09-8f2ed7affff5" released by "delete_volume" :: held 0.685s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:19 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Created reservations ['1e42fadd-fde1-4ce8-aff4-81e3ab49a5c2', 'b08e47b7-2f49-4a99-8840-18fe0f2bf725', '50156d0a-7fc0-4c8c-9e64-7dfd57737ead', 'a991a852-85b0-4c54-a1e9-d9de5700450a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:20 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 00:59:20 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:20 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 00:59:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Deleted volume successfully. Sep 02 00:59:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e9ebc41-4039-4708-b7fc-10de1846828f tempest-ProjectMemberTests-2044355839 None] Lock "cinder-530a58cc-1182-4026-ac09-8f2ed7affff5-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:30 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=13 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:59:30 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:INSERT=6,cinder:UPDATE=14,cinder:SELECT=6,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Flow 'volume_create_manager' (49e1ef94-307c-4732-931b-42c97a5eb946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6073d9-bf95-4b34-85aa-a71c9a55c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6073d9-bf95-4b34-85aa-a71c9a55c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2086232766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc11770-f276-46f5-a207-e32a0e0bf82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbb5b45e8a94eda8f6f05d85b7c29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:51Z,use_quota=True,user_id='778fd8aef5014c2792370a92f717de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a020497-27a8-4247-a163-d9bebdd70ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a020497-27a8-4247-a163-d9bebdd70ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ad33c-33cb-475c-b730-12818673079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24ad33c-33cb-475c-b730-12818673079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc11770-f276-46f5-a207-e32a0e0bf82b', 'volume_name': 'volume-2cc11770-f276-46f5-a207-e32a0e0bf82b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff4110b-1388-45d0-8af7-b3fcb458cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff4110b-1388-45d0-8af7-b3fcb458cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b3cf80-24f4-47c0-b912-a0231edaa3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Volume 2cc11770-f276-46f5-a207-e32a0e0bf82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc11770-f276-46f5-a207-e32a0e0bf82b', 'volume_size': 1} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2086232766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc11770-f276-46f5-a207-e32a0e0bf82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbb5b45e8a94eda8f6f05d85b7c29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:51Z,use_quota=True,user_id='778fd8aef5014c2792370a92f717de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Creating volume 2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:59:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] casted to osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 Sep 02 00:59:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:50 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b 1073741824 Sep 02 00:59:50 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:51 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b 1073741824" returned: 0 in 0.402s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:51 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b Sep 02 00:59:51 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:51 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b3cf80-24f4-47c0-b912-a0231edaa3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc11770-f276-46f5-a207-e32a0e0bf82b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c65964-8391-4170-bc01-c4c7e3606b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Volume volume-2cc11770-f276-46f5-a207-e32a0e0bf82b (2cc11770-f276-46f5-a207-e32a0e0bf82b): created successfully Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c65964-8391-4170-bc01-c4c7e3606b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Flow 'volume_create_manager' (49e1ef94-307c-4732-931b-42c97a5eb946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cafca66a-da55-445f-9a38-08b9575543b3 tempest-SnapshotDependencyTests-1359119570 None] Created volume successfully. Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Creating offline snapshot a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c of volume 2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 02 00:59:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d70df99-da09-4c5a-8909-7d7f20144d0e]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:52 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b Sep 02 00:59:52 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:52 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:52 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c 1G Sep 02 00:59:52 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:52 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c 1G" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cc11770-f276-46f5-a207-e32a0e0bf82b -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:52 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cc11770-f276-46f5-a207-e32a0e0bf82b -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c Sep 02 00:59:52 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:53 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cc11770-f276-46f5-a207-e32a0e0bf82b -F qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" returned: 0 in 0.283s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:53 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c is being set with open permissions: ugo+rw Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:53 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c Sep 02 00:59:53 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:53 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" returned: 0 in 0.229s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:53 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.info Sep 02 00:59:53 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:53 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.info" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:53 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.info is being set with open permissions: ugo+rw Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:53 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.info Sep 02 00:59:53 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:53 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.info" returned: 0 in 0.232s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fdce7fa9-50f1-4468-ad58-3895b3596575 tempest-SnapshotDependencyTests-1359119570 None] Create snapshot completed successfully Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Flow 'volume_create_manager' (c5855e74-bc59-41a3-bbb2-1f73d3474e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6722ac-ee30-4189-98c1-cab40452060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6722ac-ee30-4189-98c1-cab40452060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T22:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e11559-510c-41e3-b748-c0a73e80de01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbb5b45e8a94eda8f6f05d85b7c29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T22:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T22:59:55Z,use_quota=True,user_id='778fd8aef5014c2792370a92f717de4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7db204b-c7ef-4060-98bb-ad8772b4cafe),volume_type_id=c7db204b-c7ef-4060-98bb-ad8772b4cafe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e97cc9f-68a1-43a5-ab18-e5ea94a1c996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e97cc9f-68a1-43a5-ab18-e5ea94a1c996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7060f8-ab81-4637-9501-18c85cf23e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d7060f8-ab81-4637-9501-18c85cf23e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44e11559-510c-41e3-b748-c0a73e80de01', 'volume_name': 'volume-44e11559-510c-41e3-b748-c0a73e80de01', 'volume_size': 1, 'snapshot_id': 'a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab585c8-41d9-4be2-8bf4-6b8f9df46c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab585c8-41d9-4be2-8bf4-6b8f9df46c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08302538-56eb-48bf-8be6-104eda0ccefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Volume 44e11559-510c-41e3-b748-c0a73e80de01: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44e11559-510c-41e3-b748-c0a73e80de01', 'volume_size': 1, 'snapshot_id': 'a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c'} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-quobyte-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c-44e11559-510c-41e3-b748-c0a73e80de01" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c-44e11559-510c-41e3-b748-c0a73e80de01" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Creating volume 44e11559-510c-41e3-b748-c0a73e80de01 from snapshot a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Selected osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1 as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-quobyte-44e11559-510c-41e3-b748-c0a73e80de01" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-44e11559-510c-41e3-b748-c0a73e80de01" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] snapshot: a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c, volume: 44e11559-510c-41e3-b748-c0a73e80de01, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e38c619-e260-4c49-8aca-50a151663ba7]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:54 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c Sep 02 00:59:54 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:55 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" returned: 0 in 0.343s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cc11770-f276-46f5-a207-e32a0e0bf82b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0427f3e5-b164-4d76-9a63-73d48b96cf72]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:55 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b Sep 02 00:59:55 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:55 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b" returned: 0 in 0.343s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Path /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 02 00:59:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:55 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 Sep 02 00:59:55 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:59 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01" returned: 0 in 3.960s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Image conversion details: src /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 02 00:59:59 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Converted 1024.00 MB image at 258.47 MB/s Sep 02 00:59:59 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 is being set with open permissions: ugo+rw Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 00:59:59 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 Sep 02 00:59:59 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 00:59:59 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01" returned: 0 in 0.235s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-44e11559-510c-41e3-b748-c0a73e80de01" released by "_copy_volume_from_snapshot" :: held 4.950s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c-44e11559-510c-41e3-b748-c0a73e80de01" released by "_create_volume_from_snapshot" :: held 5.006s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.024s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08302538-56eb-48bf-8be6-104eda0ccefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e11559-510c-41e3-b748-c0a73e80de01', 'volume_size': 1, 'snapshot_id': 'a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79f54bf-b777-458d-aa9d-dcb263f261b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 02 00:59:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Volume volume-44e11559-510c-41e3-b748-c0a73e80de01 (44e11559-510c-41e3-b748-c0a73e80de01): created successfully Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79f54bf-b777-458d-aa9d-dcb263f261b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 02 00:59:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Flow 'volume_create_manager' (c5855e74-bc59-41a3-bbb2-1f73d3474e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 02 00:59:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ed6f71dd-fc3e-43f6-81a0-5d4d257b3086 tempest-SnapshotDependencyTests-1359119570 None] Created volume successfully. Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-quobyte-2cc11770-f276-46f5-a207-e32a0e0bf82b" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-2cc11770-f276-46f5-a207-e32a0e0bf82b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-quobyte-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Deleting offline snapshot a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c of volume 2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] snapshot_file for this snap is: volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e49e6-b0f9-4abd-89f6-252b397d5e0b]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:00 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c Sep 02 01:00:00 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:00 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cc11770-f276-46f5-a207-e32a0e0bf82b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6406f06-382f-4f80-a31b-7b2b905fab75]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 01:00:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:00 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b Sep 02 01:00:00 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:01 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b" returned: 0 in 0.511s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:01 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c Sep 02 01:00:01 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:01 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:01 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c Sep 02 01:00:01 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:01 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b.a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" returned: 0 in 0.231s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c" released by "_delete_snapshot" :: held 1.490s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-2cc11770-f276-46f5-a207-e32a0e0bf82b" released by "delete_snapshot" :: held 1.511s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Created reservations ['075dc310-db5e-45ee-a098-5915f12e2ea2', '9aa5d542-1736-41f2-97fb-1aa878d60296', '5d7882ba-0376-4fb2-a0c7-e3c3fd9fb24a', '1e846f12-4f26-45af-bcbf-44617373b812'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 01:00:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Delete snapshot completed successfully. Sep 02 01:00:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf7a96ba-75ac-40c2-adfa-1f6b5f8566d2 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-a4801ef8-93f1-409f-9f52-eaa1fc2d2d0c-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-2cc11770-f276-46f5-a207-e32a0e0bf82b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-2cc11770-f276-46f5-a207-e32a0e0bf82b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-quobyte-2cc11770-f276-46f5-a207-e32a0e0bf82b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-2cc11770-f276-46f5-a207-e32a0e0bf82b" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc13dec-3599-4874-9580-a18ec8ef8406]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:02 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b Sep 02 01:00:02 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:02 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:02 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b Sep 02 01:00:02 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:02 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-2cc11770-f276-46f5-a207-e32a0e0bf82b" returned: 0 in 0.234s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-2cc11770-f276-46f5-a207-e32a0e0bf82b" released by "delete_volume" :: held 0.626s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Created reservations ['6374fde8-b3d0-4c14-b235-2a13d821171d', '5897aa44-acc2-4385-a8f3-17e9d3607a75', '0613f0d5-00a8-43f9-a064-8ec14596db02', '75d9c605-e1a8-41ce-8609-d96367ef47f7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:03 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 01:00:03 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:03 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.235s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 01:00:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Deleted volume successfully. Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-32a5039e-d281-4a7a-9798-4f705ba382a6 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-2cc11770-f276-46f5-a207-e32a0e0bf82b-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-44e11559-510c-41e3-b748-c0a73e80de01-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-44e11559-510c-41e3-b748-c0a73e80de01-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "cinder-quobyte-44e11559-510c-41e3-b748-c0a73e80de01" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-44e11559-510c-41e3-b748-c0a73e80de01" acquired by "delete_volume" :: waited 0.013s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c580a3c-8fc5-42ba-9878-696aff20b33d]: (4, 'qcow2') {{(pid=88545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:03 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 Sep 02 01:00:03 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:03 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:03 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01 Sep 02 01:00:03 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:04 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9/volume-44e11559-510c-41e3-b748-c0a73e80de01" returned: 0 in 0.237s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-quobyte-44e11559-510c-41e3-b748-c0a73e80de01" released by "delete_volume" :: held 0.613s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Created reservations ['ed314be3-77c4-4983-bb16-a182124c9064', 'c2221911-c925-4025-b93b-05a12b239a84', '2febefbd-a507-4a8f-a459-bcb157807395', '45fd142e-0605-493e-be79-83e345f0ec40'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:04 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 01:00:04 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:04 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.248s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 01:00:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Deleted volume successfully. Sep 02 01:00:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1a41bd1-062e-44ad-9e2b-eeb113065646 tempest-SnapshotDependencyTests-1359119570 None] Lock "cinder-44e11559-510c-41e3-b748-c0a73e80de01-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8a01322f-d881-404b-bd11-dad5b04619e1'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 02 01:00:12 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9 Sep 02 01:00:12 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 02 01:00:12 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ecd30a3973f175f57c85d6a44f0d4df9" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread count: 28 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 02 01:00:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f0ce4c45-3a68-4dbb-b688-dbbfe10aa2d3 None None] thread info: [<_MainThread(MainThread, started 125820783464576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 02 01:00:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=27,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 02 01:00:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=22,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}